2014-02-26 13:25:02 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-02-26 13:25:22 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-26 13:25:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 13:25:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 13:25:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 13:25:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 13:25:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 13:25:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 13:26:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 13:26:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 13:26:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 13:26:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 13:26:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 13:26:00 [DEBUG   ] Finished updating board flags in 1.614 seconds
2014-02-26 13:26:02 [DEBUG   ] Finished updating ant stats in 1.190 seconds
2014-02-26 13:26:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 13:26:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 13:26:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 13:26:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 13:26:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 13:26:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 13:26:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 13:27:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 13:27:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 13:27:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 13:27:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 13:27:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 13:27:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 13:27:00 [DEBUG   ] Finished updating board flags in 1.616 seconds
2014-02-26 13:27:02 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2014-02-26 13:27:22 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-26 13:27:35 [DEBUG   ] Got command RPT from MCS: ref #285665
2014-02-26 13:27:35 [DEBUG   ] summary = NORMAL
2014-02-26 13:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285665  14 56714 48455441 A NORMALNORMAL'
2014-02-26 13:27:35 [DEBUG   ] Got command RPT from MCS: ref #285666
2014-02-26 13:27:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 13:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285666  48 56714 48455442 A NORMALSystem calibrated and operating normally'
2014-02-26 13:27:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 13:27:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 13:27:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 13:27:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 13:27:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 13:27:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 13:28:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 13:28:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 13:28:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 13:28:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 13:28:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 13:28:00 [DEBUG   ] Finished updating board flags in 1.571 seconds
2014-02-26 13:28:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 13:28:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 13:28:42 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2014-02-26 13:28:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 13:28:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 13:28:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 13:28:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 13:28:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 13:29:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 13:29:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 13:29:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 13:29:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 13:29:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 13:29:00 [DEBUG   ] Finished updating board flags in 1.426 seconds
2014-02-26 13:29:03 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-26 13:29:22 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-02-26 13:29:43 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-02-26 13:29:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 13:29:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 13:29:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 13:29:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 13:29:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 13:30:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 13:30:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 13:30:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 13:30:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 13:30:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 13:30:00 [DEBUG   ] Finished updating board flags in 1.381 seconds
2014-02-26 13:30:03 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-26 13:30:23 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-26 13:30:43 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 13:30:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 13:30:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 13:30:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 13:30:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 13:30:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 13:31:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 13:31:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 13:31:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 13:31:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 13:31:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 13:31:00 [DEBUG   ] Finished updating board flags in 1.365 seconds
2014-02-26 13:31:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 13:31:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 13:31:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 13:32:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 13:32:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 13:32:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 13:32:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 13:32:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 13:32:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 13:32:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 13:32:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 13:32:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 13:32:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 13:32:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 13:32:01 [DEBUG   ] Finished updating board flags in 2.050 seconds
2014-02-26 13:32:03 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2014-02-26 13:32:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 13:32:35 [DEBUG   ] Got command RPT from MCS: ref #285682
2014-02-26 13:32:35 [DEBUG   ] summary = NORMAL
2014-02-26 13:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285682  14 56714 48755453 A NORMALNORMAL'
2014-02-26 13:32:35 [DEBUG   ] Got command RPT from MCS: ref #285683
2014-02-26 13:32:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 13:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285683  48 56714 48755454 A NORMALSystem calibrated and operating normally'
2014-02-26 13:32:43 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-26 13:33:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 13:33:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 13:33:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 13:33:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 13:33:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 13:33:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 13:33:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 13:33:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 13:33:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 13:33:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 13:33:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 13:33:01 [DEBUG   ] Finished updating board flags in 1.991 seconds
2014-02-26 13:33:03 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 13:33:23 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2014-02-26 13:33:43 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-02-26 13:34:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 13:34:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 13:34:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 13:34:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 13:34:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 13:34:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 13:34:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 13:34:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 13:34:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 13:34:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 13:34:01 [DEBUG   ] Finished updating board flags in 1.812 seconds
2014-02-26 13:34:04 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-26 13:34:23 [DEBUG   ] Finished updating ant stats in 0.408 seconds
2014-02-26 13:34:44 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-02-26 13:35:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 13:35:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 13:35:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 13:35:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 13:35:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 13:35:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 13:35:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 13:35:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 13:35:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 13:35:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 13:35:01 [DEBUG   ] Finished updating board flags in 1.792 seconds
2014-02-26 13:35:04 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-26 13:35:24 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 13:35:44 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 13:36:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 13:36:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 13:36:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 13:36:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 13:36:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 13:36:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 13:36:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 13:36:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 13:36:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 13:36:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 13:36:01 [DEBUG   ] Finished updating board flags in 1.610 seconds
2014-02-26 13:36:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 13:36:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 13:36:44 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 13:37:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 13:37:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 13:37:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 13:37:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 13:37:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 13:37:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 13:37:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 13:37:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 13:37:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 13:37:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 13:37:01 [DEBUG   ] Finished updating board flags in 1.589 seconds
2014-02-26 13:37:04 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2014-02-26 13:37:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 13:37:35 [DEBUG   ] Got command RPT from MCS: ref #285699
2014-02-26 13:37:35 [DEBUG   ] summary = NORMAL
2014-02-26 13:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285699  14 56714 49055449 A NORMALNORMAL'
2014-02-26 13:37:35 [DEBUG   ] Got command RPT from MCS: ref #285700
2014-02-26 13:37:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 13:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285700  48 56714 49055450 A NORMALSystem calibrated and operating normally'
2014-02-26 13:37:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-26 13:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 13:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 13:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 13:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 13:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 13:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 13:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 13:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 13:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 13:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 13:38:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 13:38:01 [DEBUG   ] Finished updating board flags in 1.412 seconds
2014-02-26 13:38:04 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 13:38:24 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 13:38:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 13:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 13:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 13:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 13:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 13:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 13:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 13:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 13:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 13:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 13:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 13:39:01 [DEBUG   ] Finished updating board flags in 1.400 seconds
2014-02-26 13:39:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 13:39:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 13:39:44 [DEBUG   ] Finished updating ant stats in 0.591 seconds
2014-02-26 13:40:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 13:40:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 13:40:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 13:40:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 13:40:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 13:40:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 13:40:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 13:40:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 13:40:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 13:40:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 13:40:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 13:40:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-02-26 13:40:02 [DEBUG   ] Finished updating board flags in 2.201 seconds
2014-02-26 13:40:04 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2014-02-26 13:40:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 13:40:45 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 13:41:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 13:41:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 13:41:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 13:41:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 13:41:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 13:41:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 13:41:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 13:41:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 13:41:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 13:41:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 13:41:01 [DEBUG   ] Finished updating board flags in 1.317 seconds
2014-02-26 13:41:05 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-26 13:41:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 13:41:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-26 13:42:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 13:42:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 13:42:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 13:42:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 13:42:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 13:42:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 13:42:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 13:42:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 13:42:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 13:42:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 13:42:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 13:42:02 [DEBUG   ] Finished updating board flags in 2.083 seconds
2014-02-26 13:42:05 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2014-02-26 13:42:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 13:42:35 [DEBUG   ] Got command RPT from MCS: ref #285716
2014-02-26 13:42:35 [DEBUG   ] summary = NORMAL
2014-02-26 13:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285716  14 56714 49355453 A NORMALNORMAL'
2014-02-26 13:42:35 [DEBUG   ] Got command RPT from MCS: ref #285717
2014-02-26 13:42:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 13:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285717  48 56714 49355454 A NORMALSystem calibrated and operating normally'
2014-02-26 13:42:45 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-26 13:43:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 13:43:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 13:43:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 13:43:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 13:43:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 13:43:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 13:43:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 13:43:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 13:43:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 13:43:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 13:43:02 [DEBUG   ] Finished updating board flags in 2.007 seconds
2014-02-26 13:43:05 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-02-26 13:43:25 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2014-02-26 13:43:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 13:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 13:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 13:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 13:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 13:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 13:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 13:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 13:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 13:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 13:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 13:44:02 [DEBUG   ] Finished updating board flags in 1.986 seconds
2014-02-26 13:44:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 13:44:26 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 13:44:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 13:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 13:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 13:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 13:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 13:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 13:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 13:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 13:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 13:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 13:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 13:45:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 13:45:02 [DEBUG   ] Finished updating board flags in 1.819 seconds
2014-02-26 13:45:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 13:45:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 13:45:46 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-26 13:46:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 13:46:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 13:46:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 13:46:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 13:46:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 13:46:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-26 13:46:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 13:46:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 13:46:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 13:46:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 13:46:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 13:46:02 [DEBUG   ] Finished updating board flags in 1.844 seconds
2014-02-26 13:46:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 13:46:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-26 13:46:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-26 13:47:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 13:47:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 13:47:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 13:47:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 13:47:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 13:47:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 13:47:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 13:47:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 13:47:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 13:47:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 13:47:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 13:47:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 13:47:02 [DEBUG   ] Finished updating board flags in 1.740 seconds
2014-02-26 13:47:06 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2014-02-26 13:47:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 13:47:35 [DEBUG   ] Got command RPT from MCS: ref #285733
2014-02-26 13:47:35 [DEBUG   ] summary = NORMAL
2014-02-26 13:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285733  14 56714 49655453 A NORMALNORMAL'
2014-02-26 13:47:35 [DEBUG   ] Got command RPT from MCS: ref #285734
2014-02-26 13:47:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 13:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285734  48 56714 49655454 A NORMALSystem calibrated and operating normally'
2014-02-26 13:47:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 13:48:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 13:48:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 13:48:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 13:48:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 13:48:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 13:48:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 13:48:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 13:48:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 13:48:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 13:48:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 13:48:02 [DEBUG   ] Finished updating board flags in 1.623 seconds
2014-02-26 13:48:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 13:48:26 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2014-02-26 13:48:47 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-26 13:49:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 13:49:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 13:49:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 13:49:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 13:49:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 13:49:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 13:49:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 13:49:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 13:49:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 13:49:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 13:49:02 [DEBUG   ] Finished updating board flags in 1.587 seconds
2014-02-26 13:49:06 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-26 13:49:26 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-02-26 13:49:47 [DEBUG   ] Finished updating ant stats in 1.391 seconds
2014-02-26 13:50:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 13:50:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 13:50:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 13:50:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 13:50:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 13:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 13:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 13:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 13:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 13:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 13:50:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 13:50:02 [DEBUG   ] Finished updating board flags in 1.432 seconds
2014-02-26 13:50:07 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2014-02-26 13:50:27 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 13:50:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 13:51:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 13:51:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 13:51:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 13:51:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 13:51:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 13:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 13:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 13:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 13:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 13:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 13:51:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 13:51:02 [DEBUG   ] Finished updating board flags in 1.384 seconds
2014-02-26 13:51:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 13:51:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 13:51:47 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 13:52:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 13:52:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 13:52:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 13:52:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 13:52:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 13:52:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 13:52:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 13:52:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 13:52:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 13:52:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 13:52:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 13:52:02 [DEBUG   ] Finished updating board flags in 1.385 seconds
2014-02-26 13:52:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 13:52:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 13:52:35 [DEBUG   ] Got command RPT from MCS: ref #285750
2014-02-26 13:52:35 [DEBUG   ] summary = NORMAL
2014-02-26 13:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285750  14 56714 49955449 A NORMALNORMAL'
2014-02-26 13:52:35 [DEBUG   ] Got command RPT from MCS: ref #285751
2014-02-26 13:52:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 13:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285751  48 56714 49955450 A NORMALSystem calibrated and operating normally'
2014-02-26 13:52:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-26 13:53:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 13:53:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 13:53:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 13:53:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 13:53:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 13:53:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 13:53:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 13:53:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 13:53:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 13:53:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 13:53:03 [DEBUG   ] Finished updating board flags in 2.041 seconds
2014-02-26 13:53:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-26 13:53:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 13:53:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 13:53:50 [DEBUG   ] Got command TBW from MCS: ref #285768
2014-02-26 13:53:50 [DEBUG   ] tbw = exited with status True, code 0x00
2014-02-26 13:53:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   285768   8 56714 50030178 A NORMAL'
2014-02-26 13:53:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2014-02-26 13:53:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2014-02-26 13:53:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2014-02-26 13:53:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2014-02-26 13:53:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2014-02-26 13:53:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2014-02-26 13:53:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2014-02-26 13:53:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2014-02-26 13:53:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2014-02-26 13:53:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2014-02-26 13:53:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2014-02-26 13:53:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2014-02-26 13:53:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2014-02-26 13:53:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2014-02-26 13:53:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2014-02-26 13:53:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2014-02-26 13:53:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2014-02-26 13:53:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2014-02-26 13:53:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2014-02-26 13:53:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2014-02-26 13:53:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2014-02-26 13:53:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2014-02-26 13:53:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2014-02-26 13:53:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2014-02-26 13:53:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2014-02-26 13:53:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2014-02-26 13:53:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2014-02-26 13:53:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2014-02-26 13:53:53 [DEBUG   ] spawn_process: at 2014-02-26 13:53:53 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2014-02-26 13:53:53 [DEBUG   ] spawn_process: at 2014-02-26 13:53:53 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2014-02-26 13:53:53 [DEBUG   ] spawn_process: at 2014-02-26 13:53:53 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2014-02-26 13:53:53 [DEBUG   ] spawn_process: at 2014-02-26 13:53:53 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2014-02-26 13:53:53 [DEBUG   ] spawn_process: at 2014-02-26 13:53:53 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2014-02-26 13:53:53 [DEBUG   ] spawn_process: at 2014-02-26 13:53:53 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2014-02-26 13:53:53 [DEBUG   ] spawn_process: at 2014-02-26 13:53:53 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2014-02-26 13:53:53 [DEBUG   ] spawn_process: at 2014-02-26 13:53:53 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2014-02-26 13:53:53 [DEBUG   ] spawn_process: at 2014-02-26 13:53:53 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2014-02-26 13:53:53 [DEBUG   ] spawn_process: at 2014-02-26 13:53:53 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2014-02-26 13:53:53 [DEBUG   ] spawn_process: at 2014-02-26 13:53:53 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2014-02-26 13:53:53 [DEBUG   ] spawn_process: at 2014-02-26 13:53:53 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2014-02-26 13:53:53 [DEBUG   ] spawn_process: at 2014-02-26 13:53:53 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2014-02-26 13:53:53 [DEBUG   ] spawn_process: at 2014-02-26 13:53:53 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2014-02-26 13:53:53 [DEBUG   ] spawn_process: at 2014-02-26 13:53:53 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2014-02-26 13:53:53 [DEBUG   ] spawn_process: at 2014-02-26 13:53:53 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2014-02-26 13:53:53 [DEBUG   ] spawn_process: at 2014-02-26 13:53:53 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2014-02-26 13:53:53 [DEBUG   ] spawn_process: at 2014-02-26 13:53:53 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2014-02-26 13:53:53 [DEBUG   ] spawn_process: at 2014-02-26 13:53:53 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2014-02-26 13:53:53 [DEBUG   ] spawn_process: at 2014-02-26 13:53:53 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2014-02-26 13:53:53 [DEBUG   ] spawn_process: at 2014-02-26 13:53:53 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2014-02-26 13:53:53 [DEBUG   ] spawn_process: at 2014-02-26 13:53:53 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2014-02-26 13:53:53 [DEBUG   ] spawn_process: at 2014-02-26 13:53:53 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2014-02-26 13:53:53 [DEBUG   ] spawn_process: at 2014-02-26 13:53:53 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2014-02-26 13:53:53 [DEBUG   ] spawn_process: at 2014-02-26 13:53:53 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2014-02-26 13:53:53 [DEBUG   ] spawn_process: at 2014-02-26 13:53:53 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2014-02-26 13:53:53 [INFO    ] Finished spawning TBW
2014-02-26 13:54:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 13:54:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 13:54:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 13:54:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 13:54:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 13:54:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 13:54:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 13:54:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 13:54:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 13:54:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 13:54:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2014-02-26 13:54:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-02-26 13:54:02 [DEBUG   ] Finished updating board flags in 1.253 seconds
2014-02-26 13:55:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 13:55:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 13:55:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 13:55:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 13:55:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 13:55:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 13:55:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 13:55:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 13:55:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 13:55:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 13:55:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-02-26 13:55:03 [DEBUG   ] Finished updating board flags in 1.850 seconds
2014-02-26 13:56:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 13:56:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 13:56:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 13:56:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 13:56:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 13:56:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 13:56:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 13:56:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 13:56:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 13:56:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 13:56:02 [DEBUG   ] Finished updating board flags in 1.140 seconds
2014-02-26 13:57:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 13:57:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 13:57:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 13:57:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 13:57:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 13:57:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 13:57:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 13:57:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 13:57:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 13:57:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 13:57:03 [DEBUG   ] Finished updating board flags in 1.670 seconds
2014-02-26 13:57:31 [INFO    ] __waitForTBW - TBW finished in 218.224 s
2014-02-26 13:57:32 [DEBUG   ] Finished updating ant stats in 0.368 seconds
2014-02-26 13:57:32 [INFO    ] Started antennas statistics background thread
2014-02-26 13:57:32 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2014-02-26 13:57:32 [DEBUG   ] spawn_process: at 2014-02-26 13:57:32 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '1', '1393423054']
2014-02-26 13:57:32 [DEBUG   ] spawn_process: at 2014-02-26 13:57:32 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '2', '1393423054']
2014-02-26 13:57:32 [DEBUG   ] spawn_process: at 2014-02-26 13:57:32 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '3', '1393423054']
2014-02-26 13:57:32 [DEBUG   ] spawn_process: at 2014-02-26 13:57:32 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '4', '1393423054']
2014-02-26 13:57:32 [DEBUG   ] spawn_process: at 2014-02-26 13:57:32 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '5', '1393423054']
2014-02-26 13:57:32 [DEBUG   ] spawn_process: at 2014-02-26 13:57:32 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '6', '1393423054']
2014-02-26 13:57:32 [DEBUG   ] spawn_process: at 2014-02-26 13:57:32 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '7', '1393423054']
2014-02-26 13:57:32 [DEBUG   ] spawn_process: at 2014-02-26 13:57:32 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '8', '1393423054']
2014-02-26 13:57:32 [DEBUG   ] spawn_process: at 2014-02-26 13:57:32 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '9', '1393423054']
2014-02-26 13:57:32 [DEBUG   ] spawn_process: at 2014-02-26 13:57:32 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '10', '1393423054']
2014-02-26 13:57:32 [DEBUG   ] spawn_process: at 2014-02-26 13:57:32 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '11', '1393423054']
2014-02-26 13:57:32 [DEBUG   ] spawn_process: at 2014-02-26 13:57:32 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '12', '1393423054']
2014-02-26 13:57:32 [DEBUG   ] spawn_process: at 2014-02-26 13:57:32 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '13', '1393423054']
2014-02-26 13:57:32 [DEBUG   ] spawn_process: at 2014-02-26 13:57:32 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '14', '1393423054']
2014-02-26 13:57:32 [DEBUG   ] spawn_process: at 2014-02-26 13:57:32 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '15', '1393423054']
2014-02-26 13:57:32 [DEBUG   ] spawn_process: at 2014-02-26 13:57:32 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '16', '1393423054']
2014-02-26 13:57:32 [DEBUG   ] spawn_process: at 2014-02-26 13:57:32 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '17', '1393423054']
2014-02-26 13:57:32 [DEBUG   ] spawn_process: at 2014-02-26 13:57:32 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '18', '1393423054']
2014-02-26 13:57:32 [DEBUG   ] spawn_process: at 2014-02-26 13:57:32 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '19', '1393423054']
2014-02-26 13:57:32 [DEBUG   ] spawn_process: at 2014-02-26 13:57:32 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '20', '1393423054']
2014-02-26 13:57:32 [DEBUG   ] spawn_process: at 2014-02-26 13:57:32 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '21', '1393423054']
2014-02-26 13:57:32 [DEBUG   ] spawn_process: at 2014-02-26 13:57:32 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '22', '1393423054']
2014-02-26 13:57:32 [DEBUG   ] spawn_process: at 2014-02-26 13:57:32 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '23', '1393423054']
2014-02-26 13:57:32 [DEBUG   ] spawn_process: at 2014-02-26 13:57:32 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '24', '1393423054']
2014-02-26 13:57:32 [DEBUG   ] spawn_process: at 2014-02-26 13:57:32 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '25', '1393423054']
2014-02-26 13:57:32 [DEBUG   ] spawn_process: at 2014-02-26 13:57:32 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '26', '1393423054']
2014-02-26 13:57:32 [INFO    ] Finished spawning TBN in 0.049 s
2014-02-26 13:57:35 [DEBUG   ] Got command RPT from MCS: ref #285777
2014-02-26 13:57:35 [DEBUG   ] summary = NORMAL
2014-02-26 13:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285777  14 56714 50255453 A NORMALNORMAL'
2014-02-26 13:57:35 [DEBUG   ] Got command RPT from MCS: ref #285778
2014-02-26 13:57:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 13:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285778  48 56714 50255454 A NORMALSystem calibrated and operating normally'
2014-02-26 13:57:53 [DEBUG   ] Finished updating ant stats in 1.270 seconds
2014-02-26 13:58:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 13:58:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 13:58:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 13:58:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 13:58:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 13:58:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 13:58:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 13:58:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 13:58:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 13:58:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 13:58:03 [DEBUG   ] Finished updating board flags in 1.815 seconds
2014-02-26 13:58:13 [DEBUG   ] Finished updating ant stats in 1.193 seconds
2014-02-26 13:58:33 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-26 13:58:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 13:59:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 13:59:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 13:59:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 13:59:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 13:59:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 13:59:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 13:59:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 13:59:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 13:59:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 13:59:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 13:59:03 [DEBUG   ] Finished updating board flags in 1.662 seconds
2014-02-26 13:59:13 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2014-02-26 13:59:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 13:59:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 14:00:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:00:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:00:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:00:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:00:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:00:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:00:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:00:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:00:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:00:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:00:03 [DEBUG   ] Finished updating board flags in 1.606 seconds
2014-02-26 14:00:13 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2014-02-26 14:00:33 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-26 14:00:53 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2014-02-26 14:01:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:01:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:01:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:01:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:01:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:01:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:01:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:01:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:01:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:01:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:01:03 [DEBUG   ] Finished updating board flags in 1.602 seconds
2014-02-26 14:01:14 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-02-26 14:01:34 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-26 14:01:54 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 14:02:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:02:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:02:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:02:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:02:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:02:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:02:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:02:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:02:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:02:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:02:03 [DEBUG   ] Finished updating board flags in 1.601 seconds
2014-02-26 14:02:14 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-02-26 14:02:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 14:02:35 [DEBUG   ] Got command RPT from MCS: ref #285796
2014-02-26 14:02:35 [DEBUG   ] summary = NORMAL
2014-02-26 14:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285796  14 56714 50555461 A NORMALNORMAL'
2014-02-26 14:02:35 [DEBUG   ] Got command RPT from MCS: ref #285797
2014-02-26 14:02:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 14:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285797  48 56714 50555462 A NORMALSystem calibrated and operating normally'
2014-02-26 14:02:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 14:03:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:03:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:03:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:03:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:03:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:03:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:03:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:03:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:03:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:03:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:03:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 14:03:03 [DEBUG   ] Finished updating board flags in 1.596 seconds
2014-02-26 14:03:14 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 14:03:34 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-02-26 14:03:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 14:04:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:04:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:04:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:04:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:04:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:04:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:04:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:04:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:04:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:04:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:04:03 [DEBUG   ] Finished updating board flags in 1.398 seconds
2014-02-26 14:04:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 14:04:34 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 14:04:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-26 14:05:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:05:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:05:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:05:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:05:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:05:03 [DEBUG   ] Finished updating board flags in 1.354 seconds
2014-02-26 14:05:15 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-02-26 14:05:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 14:05:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 14:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:06:04 [DEBUG   ] Finished updating board flags in 2.064 seconds
2014-02-26 14:06:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 14:06:35 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 14:06:55 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 14:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:07:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-26 14:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:07:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-26 14:07:04 [DEBUG   ] Finished updating board flags in 1.981 seconds
2014-02-26 14:07:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 14:07:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 14:07:35 [DEBUG   ] Got command RPT from MCS: ref #285813
2014-02-26 14:07:35 [DEBUG   ] summary = NORMAL
2014-02-26 14:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285813  14 56714 50855453 A NORMALNORMAL'
2014-02-26 14:07:35 [DEBUG   ] Got command RPT from MCS: ref #285814
2014-02-26 14:07:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 14:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285814  48 56714 50855454 A NORMALSystem calibrated and operating normally'
2014-02-26 14:07:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 14:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:08:04 [DEBUG   ] Finished updating board flags in 1.822 seconds
2014-02-26 14:08:15 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-26 14:08:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 14:08:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 14:09:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:09:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:09:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:09:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:09:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:09:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:09:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:09:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:09:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:09:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:09:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 14:09:04 [DEBUG   ] Finished updating board flags in 1.793 seconds
2014-02-26 14:09:15 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-26 14:09:35 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-26 14:09:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 14:10:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:10:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:10:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:10:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:10:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:10:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:10:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:10:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:10:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:10:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:10:04 [DEBUG   ] Finished updating board flags in 1.609 seconds
2014-02-26 14:10:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 14:10:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 14:10:55 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-26 14:11:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:11:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:11:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:11:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:11:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:11:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:11:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:11:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:11:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:11:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:11:04 [DEBUG   ] Finished updating board flags in 1.589 seconds
2014-02-26 14:11:16 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-02-26 14:11:36 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-26 14:11:56 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2014-02-26 14:12:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:12:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:12:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:12:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:12:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:12:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:12:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:12:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:12:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:12:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:12:04 [DEBUG   ] Finished updating board flags in 1.421 seconds
2014-02-26 14:12:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 14:12:35 [DEBUG   ] Got command RPT from MCS: ref #285830
2014-02-26 14:12:35 [DEBUG   ] summary = NORMAL
2014-02-26 14:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285830  14 56714 51155462 A NORMALNORMAL'
2014-02-26 14:12:35 [DEBUG   ] Got command RPT from MCS: ref #285831
2014-02-26 14:12:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 14:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285831  48 56714 51155462 A NORMALSystem calibrated and operating normally'
2014-02-26 14:12:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 14:12:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 14:13:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:13:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:13:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:13:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:13:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:13:04 [DEBUG   ] Finished updating board flags in 1.382 seconds
2014-02-26 14:13:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 14:13:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 14:13:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 14:14:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:14:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:14:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:14:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:14:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:14:04 [DEBUG   ] Finished updating board flags in 1.399 seconds
2014-02-26 14:14:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 14:14:36 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-26 14:14:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 14:15:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:15:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:15:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:15:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:15:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:15:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:15:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:15:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:15:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:15:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:15:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-02-26 14:15:05 [DEBUG   ] Finished updating board flags in 2.044 seconds
2014-02-26 14:15:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-26 14:15:36 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 14:15:56 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-26 14:16:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:16:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:16:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:16:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:16:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:16:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:16:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:16:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:16:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:16:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:16:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-02-26 14:16:05 [DEBUG   ] Finished updating board flags in 2.010 seconds
2014-02-26 14:16:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-26 14:16:37 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-26 14:16:57 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-02-26 14:17:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:17:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:17:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:17:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:17:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:17:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:17:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:17:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:17:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:17:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:17:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2014-02-26 14:17:05 [DEBUG   ] Finished updating board flags in 1.992 seconds
2014-02-26 14:17:17 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-26 14:17:35 [DEBUG   ] Got command RPT from MCS: ref #285847
2014-02-26 14:17:35 [DEBUG   ] summary = NORMAL
2014-02-26 14:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285847  14 56714 51455461 A NORMALNORMAL'
2014-02-26 14:17:35 [DEBUG   ] Got command RPT from MCS: ref #285848
2014-02-26 14:17:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 14:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285848  48 56714 51455462 A NORMALSystem calibrated and operating normally'
2014-02-26 14:17:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 14:17:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 14:18:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:18:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:18:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:18:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:18:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:18:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:18:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:18:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:18:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:18:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:18:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 14:18:05 [DEBUG   ] Finished updating board flags in 1.771 seconds
2014-02-26 14:18:17 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2014-02-26 14:18:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 14:18:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 14:19:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:19:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:19:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:19:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:19:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:19:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:19:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:19:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:19:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:19:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:19:05 [DEBUG   ] Finished updating board flags in 1.612 seconds
2014-02-26 14:19:17 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 14:19:37 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-26 14:19:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 14:20:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:20:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:20:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:20:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:20:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:20:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:20:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:20:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:20:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:20:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:20:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 14:20:05 [DEBUG   ] Finished updating board flags in 1.586 seconds
2014-02-26 14:20:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-26 14:20:37 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 14:20:57 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-26 14:21:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:21:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:21:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:21:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:21:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:21:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:21:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:21:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:21:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:21:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:21:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 14:21:05 [DEBUG   ] Finished updating board flags in 1.450 seconds
2014-02-26 14:21:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 14:21:37 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-26 14:21:57 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-02-26 14:22:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:22:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:22:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:22:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:22:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:22:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:22:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:22:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:22:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:22:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:22:05 [DEBUG   ] Finished updating board flags in 1.432 seconds
2014-02-26 14:22:18 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-02-26 14:22:35 [DEBUG   ] Got command RPT from MCS: ref #285864
2014-02-26 14:22:35 [DEBUG   ] summary = NORMAL
2014-02-26 14:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285864  14 56714 51755465 A NORMALNORMAL'
2014-02-26 14:22:35 [DEBUG   ] Got command RPT from MCS: ref #285865
2014-02-26 14:22:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 14:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285865  48 56714 51755466 A NORMALSystem calibrated and operating normally'
2014-02-26 14:22:38 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-26 14:22:58 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 14:23:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:23:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:23:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:23:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:23:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:23:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-26 14:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:23:05 [DEBUG   ] Finished updating board flags in 1.422 seconds
2014-02-26 14:23:18 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2014-02-26 14:23:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 14:23:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 14:24:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:24:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:24:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:24:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:24:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:24:05 [DEBUG   ] Finished updating board flags in 1.424 seconds
2014-02-26 14:24:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 14:24:38 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-26 14:24:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 14:25:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:25:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:25:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:25:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:25:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:25:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:25:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:25:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:25:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:25:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:25:05 [DEBUG   ] Finished updating board flags in 1.426 seconds
2014-02-26 14:25:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-26 14:25:38 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 14:25:58 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-26 14:26:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:26:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:26:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:26:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:26:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:26:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:26:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:26:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:26:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:26:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:26:05 [DEBUG   ] Finished updating board flags in 1.449 seconds
2014-02-26 14:26:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 14:26:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 14:26:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 14:27:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:27:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:27:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:27:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:27:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:27:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:27:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:27:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:27:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:27:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:27:05 [DEBUG   ] Finished updating board flags in 1.451 seconds
2014-02-26 14:27:18 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2014-02-26 14:27:35 [DEBUG   ] Got command RPT from MCS: ref #285881
2014-02-26 14:27:35 [DEBUG   ] summary = NORMAL
2014-02-26 14:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285881  14 56714 52055462 A NORMALNORMAL'
2014-02-26 14:27:35 [DEBUG   ] Got command RPT from MCS: ref #285882
2014-02-26 14:27:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 14:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285882  48 56714 52055462 A NORMALSystem calibrated and operating normally'
2014-02-26 14:27:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-26 14:27:59 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-02-26 14:28:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:28:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:28:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:28:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:28:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:28:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:28:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:28:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:28:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:28:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:28:06 [DEBUG   ] Finished updating board flags in 2.221 seconds
2014-02-26 14:28:19 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-26 14:28:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 14:28:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-26 14:29:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:29:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:29:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:29:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:29:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:29:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:29:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:29:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:29:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:29:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:29:06 [DEBUG   ] Finished updating board flags in 2.142 seconds
2014-02-26 14:29:19 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 14:29:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 14:29:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 14:30:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:30:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:30:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:30:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:30:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:30:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:30:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:30:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:30:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:30:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:30:06 [DEBUG   ] Finished updating board flags in 2.012 seconds
2014-02-26 14:30:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 14:30:39 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-26 14:30:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 14:31:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:31:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:31:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:31:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:31:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:31:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:31:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:31:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:31:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:31:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:31:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 14:31:06 [DEBUG   ] Finished updating board flags in 1.988 seconds
2014-02-26 14:31:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-26 14:31:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 14:31:59 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 14:32:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:32:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:32:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:32:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:32:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:32:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:32:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:32:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:32:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:32:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:32:06 [DEBUG   ] Finished updating board flags in 1.820 seconds
2014-02-26 14:32:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 14:32:35 [DEBUG   ] Got command RPT from MCS: ref #285898
2014-02-26 14:32:35 [DEBUG   ] summary = NORMAL
2014-02-26 14:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285898  14 56714 52355465 A NORMALNORMAL'
2014-02-26 14:32:35 [DEBUG   ] Got command RPT from MCS: ref #285899
2014-02-26 14:32:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 14:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285899  48 56714 52355466 A NORMALSystem calibrated and operating normally'
2014-02-26 14:32:39 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 14:32:59 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 14:33:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:33:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:33:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:33:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:33:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:33:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:33:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:33:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:33:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:33:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:33:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-02-26 14:33:06 [DEBUG   ] Finished updating board flags in 1.787 seconds
2014-02-26 14:33:19 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 14:33:40 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-02-26 14:34:00 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-26 14:34:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:34:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:34:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:34:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:34:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:34:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:34:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:34:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:34:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:34:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:34:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-02-26 14:34:06 [DEBUG   ] Finished updating board flags in 1.620 seconds
2014-02-26 14:34:20 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 14:34:40 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-02-26 14:35:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 14:35:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:35:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:35:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:35:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:35:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:35:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:35:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:35:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:35:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:35:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:35:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 14:35:06 [DEBUG   ] Finished updating board flags in 1.584 seconds
2014-02-26 14:35:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 14:35:40 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 14:36:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 14:36:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:36:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:36:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:36:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:36:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:36:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-26 14:36:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:36:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:36:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:36:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:36:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:36:06 [DEBUG   ] Finished updating board flags in 1.455 seconds
2014-02-26 14:36:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 14:36:40 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-26 14:37:00 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 14:37:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:37:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:37:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:37:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:37:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:37:06 [DEBUG   ] Finished updating board flags in 1.458 seconds
2014-02-26 14:37:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 14:37:35 [DEBUG   ] Got command RPT from MCS: ref #285915
2014-02-26 14:37:35 [DEBUG   ] summary = NORMAL
2014-02-26 14:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285915  14 56714 52655469 A NORMALNORMAL'
2014-02-26 14:37:35 [DEBUG   ] Got command RPT from MCS: ref #285916
2014-02-26 14:37:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 14:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285916  48 56714 52655470 A NORMALSystem calibrated and operating normally'
2014-02-26 14:37:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 14:38:00 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-26 14:38:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:38:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:38:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:38:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:38:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:38:06 [DEBUG   ] Finished updating board flags in 1.452 seconds
2014-02-26 14:38:20 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-26 14:38:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 14:39:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 14:39:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:39:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:39:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:39:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:39:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:39:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:39:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:39:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:39:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:39:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:39:06 [DEBUG   ] Finished updating board flags in 1.454 seconds
2014-02-26 14:39:20 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 14:39:40 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 14:40:00 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-02-26 14:40:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:40:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:40:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:40:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:40:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:40:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:40:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:40:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:40:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:40:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:40:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 14:40:07 [DEBUG   ] Finished updating board flags in 2.288 seconds
2014-02-26 14:40:21 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-02-26 14:40:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 14:41:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 14:41:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:41:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:41:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:41:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:41:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:41:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:41:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:41:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:41:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:41:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:41:07 [DEBUG   ] Finished updating board flags in 2.105 seconds
2014-02-26 14:41:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 14:41:41 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 14:42:01 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-26 14:42:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:42:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:42:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:42:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:42:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:42:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:42:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:42:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:42:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:42:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:42:07 [DEBUG   ] Finished updating board flags in 2.046 seconds
2014-02-26 14:42:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 14:42:35 [DEBUG   ] Got command RPT from MCS: ref #285932
2014-02-26 14:42:35 [DEBUG   ] summary = NORMAL
2014-02-26 14:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285932  14 56714 52955466 A NORMALNORMAL'
2014-02-26 14:42:35 [DEBUG   ] Got command RPT from MCS: ref #285933
2014-02-26 14:42:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 14:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285933  48 56714 52955466 A NORMALSystem calibrated and operating normally'
2014-02-26 14:42:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 14:43:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-26 14:43:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:43:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:43:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:43:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:43:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:43:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-26 14:43:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:43:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:43:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:43:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:43:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:43:07 [DEBUG   ] Finished updating board flags in 1.956 seconds
2014-02-26 14:43:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-26 14:43:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 14:44:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-26 14:44:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:44:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:44:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:44:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:44:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:44:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:44:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:44:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:44:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:44:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:44:07 [DEBUG   ] Finished updating board flags in 1.816 seconds
2014-02-26 14:44:21 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-26 14:44:41 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 14:45:01 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-02-26 14:45:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:45:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:45:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:45:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:45:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:45:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:45:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:45:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:45:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:45:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:45:07 [DEBUG   ] Finished updating board flags in 1.808 seconds
2014-02-26 14:45:22 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-02-26 14:45:42 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-02-26 14:46:02 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-26 14:46:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:46:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:46:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:46:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:46:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:46:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:46:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:46:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:46:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:46:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:46:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 14:46:07 [DEBUG   ] Finished updating board flags in 1.787 seconds
2014-02-26 14:46:22 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2014-02-26 14:46:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 14:47:02 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-26 14:47:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:47:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:47:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:47:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:47:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:47:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:47:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:47:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:47:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:47:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:47:07 [DEBUG   ] Finished updating board flags in 1.604 seconds
2014-02-26 14:47:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 14:47:35 [DEBUG   ] Got command RPT from MCS: ref #285949
2014-02-26 14:47:35 [DEBUG   ] summary = NORMAL
2014-02-26 14:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285949  14 56714 53255462 A NORMALNORMAL'
2014-02-26 14:47:35 [DEBUG   ] Got command RPT from MCS: ref #285950
2014-02-26 14:47:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 14:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285950  48 56714 53255462 A NORMALSystem calibrated and operating normally'
2014-02-26 14:47:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-26 14:48:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-26 14:48:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:48:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:48:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:48:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:48:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:48:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:48:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:48:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:48:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:48:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:48:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-02-26 14:48:07 [DEBUG   ] Finished updating board flags in 1.624 seconds
2014-02-26 14:48:22 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-02-26 14:48:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 14:49:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 14:49:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:49:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:49:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:49:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:49:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:49:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:49:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:49:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:49:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:49:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:49:07 [DEBUG   ] Finished updating board flags in 1.577 seconds
2014-02-26 14:49:22 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 14:49:42 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-02-26 14:50:03 [DEBUG   ] Finished updating ant stats in 1.392 seconds
2014-02-26 14:50:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:50:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:50:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:50:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:50:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:50:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:50:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:50:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:50:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:50:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:50:07 [DEBUG   ] Finished updating board flags in 1.407 seconds
2014-02-26 14:50:23 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 14:50:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 14:51:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 14:51:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:51:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:51:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:51:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:51:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:51:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:51:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:51:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:51:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:51:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:51:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 14:51:07 [DEBUG   ] Finished updating board flags in 1.415 seconds
2014-02-26 14:51:23 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 14:51:43 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 14:52:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 14:52:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:52:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:52:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:52:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:52:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:52:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-26 14:52:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:52:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:52:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:52:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:52:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:52:07 [DEBUG   ] Finished updating board flags in 1.381 seconds
2014-02-26 14:52:23 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 14:52:35 [DEBUG   ] Got command RPT from MCS: ref #285966
2014-02-26 14:52:35 [DEBUG   ] summary = NORMAL
2014-02-26 14:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285966  14 56714 53555479 A NORMALNORMAL'
2014-02-26 14:52:35 [DEBUG   ] Got command RPT from MCS: ref #285967
2014-02-26 14:52:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 14:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285967  48 56714 53555479 A NORMALSystem calibrated and operating normally'
2014-02-26 14:52:43 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 14:53:03 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 14:53:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:53:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:53:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:53:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:53:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:53:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:53:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:53:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:53:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:53:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:53:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 14:53:07 [DEBUG   ] Finished updating board flags in 1.393 seconds
2014-02-26 14:53:23 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-02-26 14:53:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 14:54:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 14:54:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:54:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:54:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:54:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:54:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:54:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:54:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:54:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:54:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:54:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:54:08 [DEBUG   ] Finished updating board flags in 2.061 seconds
2014-02-26 14:54:23 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-26 14:54:43 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-26 14:55:03 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-02-26 14:55:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:55:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:55:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:55:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:55:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:55:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:55:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:55:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:55:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:55:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:55:08 [DEBUG   ] Finished updating board flags in 1.951 seconds
2014-02-26 14:55:24 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-02-26 14:55:44 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-26 14:56:04 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 14:56:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:56:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:56:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:56:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:56:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:56:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:56:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:56:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:56:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:56:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:56:08 [DEBUG   ] Finished updating board flags in 1.815 seconds
2014-02-26 14:56:24 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 14:56:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 14:57:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 14:57:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:57:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:57:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:57:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:57:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:57:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-26 14:57:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:57:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:57:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:57:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:57:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:57:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 14:57:08 [DEBUG   ] Finished updating board flags in 1.818 seconds
2014-02-26 14:57:24 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-26 14:57:35 [DEBUG   ] Got command RPT from MCS: ref #285983
2014-02-26 14:57:35 [DEBUG   ] summary = NORMAL
2014-02-26 14:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285983  14 56714 53855466 A NORMALNORMAL'
2014-02-26 14:57:35 [DEBUG   ] Got command RPT from MCS: ref #285984
2014-02-26 14:57:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 14:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285984  48 56714 53855466 A NORMALSystem calibrated and operating normally'
2014-02-26 14:57:44 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 14:58:04 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 14:58:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:58:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:58:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:58:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:58:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:58:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:58:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:58:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:58:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:58:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:58:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 14:58:08 [DEBUG   ] Finished updating board flags in 1.842 seconds
2014-02-26 14:58:24 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-26 14:58:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 14:59:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-26 14:59:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 14:59:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 14:59:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 14:59:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 14:59:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 14:59:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 14:59:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 14:59:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 14:59:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 14:59:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 14:59:08 [DEBUG   ] Finished updating board flags in 1.739 seconds
2014-02-26 14:59:24 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-26 14:59:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 15:00:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 15:00:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 15:00:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 15:00:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 15:00:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 15:00:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 15:00:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 15:00:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 15:00:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 15:00:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 15:00:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 15:00:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 15:00:08 [DEBUG   ] Finished updating board flags in 1.614 seconds
2014-02-26 15:00:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 15:00:44 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-26 15:01:04 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-26 15:01:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 15:01:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 15:01:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 15:01:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 15:01:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 15:01:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 15:01:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 15:01:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 15:01:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 15:01:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 15:01:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-02-26 15:01:08 [DEBUG   ] Finished updating board flags in 1.582 seconds
2014-02-26 15:01:25 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-26 15:01:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 15:02:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 15:02:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 15:02:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 15:02:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 15:02:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 15:02:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 15:02:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 15:02:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 15:02:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 15:02:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 15:02:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 15:02:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2014-02-26 15:02:08 [DEBUG   ] Finished updating board flags in 1.422 seconds
2014-02-26 15:02:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 15:02:35 [DEBUG   ] Got command RPT from MCS: ref #286000
2014-02-26 15:02:35 [DEBUG   ] summary = NORMAL
2014-02-26 15:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286000  14 56714 54155465 A NORMALNORMAL'
2014-02-26 15:02:35 [DEBUG   ] Got command RPT from MCS: ref #286001
2014-02-26 15:02:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 15:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286001  48 56714 54155466 A NORMALSystem calibrated and operating normally'
2014-02-26 15:02:45 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-26 15:03:05 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 15:03:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 15:03:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 15:03:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 15:03:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 15:03:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 15:03:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-26 15:03:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 15:03:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 15:03:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 15:03:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 15:03:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 15:03:08 [DEBUG   ] Finished updating board flags in 1.400 seconds
2014-02-26 15:03:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 15:03:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 15:04:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 15:04:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 15:04:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 15:04:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 15:04:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 15:04:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 15:04:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 15:04:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 15:04:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 15:04:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 15:04:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 15:04:08 [DEBUG   ] Finished updating board flags in 1.416 seconds
2014-02-26 15:04:25 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 15:04:45 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-02-26 15:05:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 15:05:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 15:05:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 15:05:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 15:05:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 15:05:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 15:05:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 15:05:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 15:05:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 15:05:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 15:05:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 15:05:08 [DEBUG   ] Finished updating board flags in 1.392 seconds
2014-02-26 15:05:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 15:05:45 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-26 15:06:06 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-02-26 15:06:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 15:06:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 15:06:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 15:06:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 15:06:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 15:06:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 15:06:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 15:06:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 15:06:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 15:06:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 15:06:09 [DEBUG   ] Finished updating board flags in 2.200 seconds
2014-02-26 15:06:26 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-26 15:06:46 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-02-26 15:07:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 15:07:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 15:07:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 15:07:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 15:07:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 15:07:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 15:07:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 15:07:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 15:07:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 15:07:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 15:07:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 15:07:09 [DEBUG   ] Finished updating board flags in 1.994 seconds
2014-02-26 15:07:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 15:07:35 [DEBUG   ] Got command RPT from MCS: ref #286017
2014-02-26 15:07:35 [DEBUG   ] summary = NORMAL
2014-02-26 15:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286017  14 56714 54455474 A NORMALNORMAL'
2014-02-26 15:07:35 [DEBUG   ] Got command RPT from MCS: ref #286018
2014-02-26 15:07:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 15:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286018  48 56714 54455474 A NORMALSystem calibrated and operating normally'
2014-02-26 15:07:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 15:08:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 15:08:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 15:08:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 15:08:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 15:08:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 15:08:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 15:08:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 15:08:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 15:08:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 15:08:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 15:08:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 15:08:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 15:08:09 [DEBUG   ] Finished updating board flags in 1.863 seconds
2014-02-26 15:08:26 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-26 15:08:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-26 15:09:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 15:09:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 15:09:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 15:09:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 15:09:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 15:09:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 15:09:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 15:09:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 15:09:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 15:09:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 15:09:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 15:09:09 [DEBUG   ] Finished updating board flags in 1.746 seconds
2014-02-26 15:09:26 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-26 15:09:46 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-26 15:10:06 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-02-26 15:10:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 15:10:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 15:10:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 15:10:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 15:10:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 15:10:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 15:10:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 15:10:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 15:10:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 15:10:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 15:10:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 15:10:09 [DEBUG   ] Finished updating board flags in 1.615 seconds
2014-02-26 15:10:27 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-02-26 15:10:47 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-26 15:11:07 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-26 15:11:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 15:11:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 15:11:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 15:11:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 15:11:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 15:11:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 15:11:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 15:11:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 15:11:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 15:11:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 15:11:09 [DEBUG   ] Finished updating board flags in 1.586 seconds
2014-02-26 15:11:27 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 15:11:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 15:12:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 15:12:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 15:12:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 15:12:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 15:12:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 15:12:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 15:12:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 15:12:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 15:12:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 15:12:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 15:12:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 15:12:09 [DEBUG   ] Finished updating board flags in 1.414 seconds
2014-02-26 15:12:27 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-26 15:12:35 [DEBUG   ] Got command RPT from MCS: ref #286034
2014-02-26 15:12:35 [DEBUG   ] summary = NORMAL
2014-02-26 15:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286034  14 56714 54755470 A NORMALNORMAL'
2014-02-26 15:12:35 [DEBUG   ] Got command RPT from MCS: ref #286035
2014-02-26 15:12:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 15:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286035  48 56714 54755470 A NORMALSystem calibrated and operating normally'
2014-02-26 15:12:47 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-26 15:13:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 15:13:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 15:13:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 15:13:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 15:13:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 15:13:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 15:13:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-26 15:13:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 15:13:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 15:13:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 15:13:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 15:13:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 15:13:09 [DEBUG   ] Finished updating board flags in 1.389 seconds
2014-02-26 15:13:27 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-26 15:13:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 15:14:07 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 15:14:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 15:14:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 15:14:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 15:14:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 15:14:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 15:14:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 15:14:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 15:14:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 15:14:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 15:14:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 15:14:09 [DEBUG   ] Finished updating board flags in 1.376 seconds
2014-02-26 15:14:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 15:14:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 15:15:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 15:15:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 15:15:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 15:15:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 15:15:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 15:15:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 15:15:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 15:15:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 15:15:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 15:15:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 15:15:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 15:15:10 [DEBUG   ] Finished updating board flags in 2.050 seconds
2014-02-26 15:15:27 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2014-02-26 15:15:47 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2014-02-26 15:16:08 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-26 15:16:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 15:16:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 15:16:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 15:16:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 15:16:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 15:16:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 15:16:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 15:16:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 15:16:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 15:16:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 15:16:10 [DEBUG   ] Finished updating board flags in 1.978 seconds
2014-02-26 15:16:28 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 15:16:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 15:17:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 15:17:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 15:17:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 15:17:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 15:17:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 15:17:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 15:17:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 15:17:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 15:17:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 15:17:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 15:17:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 15:17:11 [DEBUG   ] Finished updating board flags in 2.813 seconds
2014-02-26 15:17:28 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-26 15:17:35 [DEBUG   ] Got command RPT from MCS: ref #286051
2014-02-26 15:17:35 [DEBUG   ] summary = NORMAL
2014-02-26 15:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286051  14 56714 55055469 A NORMALNORMAL'
2014-02-26 15:17:35 [DEBUG   ] Got command RPT from MCS: ref #286052
2014-02-26 15:17:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 15:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286052  48 56714 55055470 A NORMALSystem calibrated and operating normally'
2014-02-26 15:17:48 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 15:18:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 15:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 15:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 15:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 15:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 15:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 15:18:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 15:18:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 15:18:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 15:18:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 15:18:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 15:18:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 15:18:10 [DEBUG   ] Finished updating board flags in 1.791 seconds
2014-02-26 15:18:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-26 15:18:48 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 15:19:08 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 15:19:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 15:19:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 15:19:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 15:19:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 15:19:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 15:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 15:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 15:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 15:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 15:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 15:19:10 [DEBUG   ] Finished updating board flags in 1.618 seconds
2014-02-26 15:19:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 15:19:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 15:20:08 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 15:20:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 15:20:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 15:20:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 15:20:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 15:20:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 15:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 15:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 15:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 15:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 15:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 15:20:10 [DEBUG   ] Finished updating board flags in 1.591 seconds
2014-02-26 15:20:28 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 15:20:48 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-02-26 15:21:08 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-02-26 15:21:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 15:21:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 15:21:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 15:21:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 15:21:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 15:21:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 15:21:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 15:21:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 15:21:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 15:21:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 15:21:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 15:21:10 [DEBUG   ] Finished updating board flags in 1.411 seconds
2014-02-26 15:21:29 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-02-26 15:21:49 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-26 15:22:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 15:22:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 15:22:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 15:22:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 15:22:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 15:22:09 [DEBUG   ] Finished updating ant stats in 1.249 seconds
2014-02-26 15:22:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 15:22:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 15:22:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 15:22:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 15:22:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 15:22:10 [DEBUG   ] Finished updating board flags in 1.412 seconds
2014-02-26 15:22:29 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2014-02-26 15:22:35 [DEBUG   ] Got command RPT from MCS: ref #286068
2014-02-26 15:22:35 [DEBUG   ] summary = NORMAL
2014-02-26 15:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286068  14 56714 55355481 A NORMALNORMAL'
2014-02-26 15:22:35 [DEBUG   ] Got command RPT from MCS: ref #286069
2014-02-26 15:22:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 15:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286069  48 56714 55355482 A NORMALSystem calibrated and operating normally'
2014-02-26 15:22:49 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 15:23:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 15:23:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 15:23:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 15:23:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 15:23:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 15:23:09 [DEBUG   ] Finished updating ant stats in 0.829 seconds
2014-02-26 15:23:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 15:23:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 15:23:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 15:23:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 15:23:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 15:23:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 15:23:10 [DEBUG   ] Finished updating board flags in 1.383 seconds
2014-02-26 15:23:29 [DEBUG   ] Finished updating ant stats in 0.775 seconds
2014-02-26 15:23:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 15:24:09 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-26 15:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 15:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 15:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 15:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 15:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 15:24:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 15:24:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 15:24:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 15:24:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 15:24:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 15:24:10 [DEBUG   ] Finished updating board flags in 1.348 seconds
2014-02-26 15:24:29 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-26 15:24:50 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-02-26 15:25:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 15:25:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 15:25:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 15:25:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 15:25:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 15:25:10 [DEBUG   ] Finished updating ant stats in 1.384 seconds
2014-02-26 15:25:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 15:25:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 15:25:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 15:25:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 15:25:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 15:25:11 [DEBUG   ] Finished updating board flags in 2.067 seconds
2014-02-26 15:25:30 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-26 15:25:50 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 15:26:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 15:26:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 15:26:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 15:26:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 15:26:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 15:26:10 [DEBUG   ] Finished updating ant stats in 1.246 seconds
2014-02-26 15:26:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 15:26:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 15:26:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 15:26:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 15:26:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 15:26:11 [DEBUG   ] Finished updating board flags in 1.990 seconds
2014-02-26 15:26:30 [DEBUG   ] Finished updating ant stats in 1.154 seconds
2014-02-26 15:26:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 15:27:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 15:27:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 15:27:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 15:27:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 15:27:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 15:27:10 [DEBUG   ] Finished updating ant stats in 1.051 seconds
2014-02-26 15:27:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 15:27:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 15:27:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 15:27:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 15:27:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 15:27:11 [DEBUG   ] Finished updating board flags in 1.815 seconds
2014-02-26 15:27:30 [DEBUG   ] Finished updating ant stats in 0.957 seconds
2014-02-26 15:27:35 [DEBUG   ] Got command RPT from MCS: ref #286085
2014-02-26 15:27:35 [DEBUG   ] summary = NORMAL
2014-02-26 15:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286085  14 56714 55655481 A NORMALNORMAL'
2014-02-26 15:27:35 [DEBUG   ] Got command RPT from MCS: ref #286086
2014-02-26 15:27:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 15:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286086  48 56714 55655482 A NORMALSystem calibrated and operating normally'
2014-02-26 15:27:50 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-02-26 15:28:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 15:28:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 15:28:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 15:28:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 15:28:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 15:28:10 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2014-02-26 15:28:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 15:28:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 15:28:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 15:28:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 15:28:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 15:28:11 [DEBUG   ] Finished updating board flags in 1.785 seconds
2014-02-26 15:28:30 [DEBUG   ] Finished updating ant stats in 0.556 seconds
2014-02-26 15:28:51 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-02-26 15:29:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 15:29:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 15:29:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 15:29:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 15:29:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 15:29:11 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2014-02-26 15:29:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 15:29:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 15:29:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 15:29:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 15:29:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 15:29:12 [DEBUG   ] Finished updating board flags in 2.615 seconds
2014-02-26 15:29:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-26 15:29:51 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 15:30:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 15:30:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 15:30:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 15:30:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 15:30:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 15:30:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-26 15:30:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 15:30:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 3533616
2014-02-26 15:30:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 3533616
2014-02-26 15:30:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 3533616
2014-02-26 15:30:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 3533616
2014-02-26 15:30:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 1, top port
2014-02-26 15:30:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 2166782
2014-02-26 15:30:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa22, chip 1 with 1152376138517843966
2014-02-26 15:30:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 2, top port
2014-02-26 15:30:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 3, top port
2014-02-26 15:30:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 4, top port
2014-02-26 15:30:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 5, top port
2014-02-26 15:30:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa22, chip 5 with 31525678435270768
2014-02-26 15:30:11 [CRITICAL] MonitorFlags: Temperature 229.80 > 90 on hostname lwa22, chip 1, Shutting down all FPGA's
2014-02-26 15:30:11 [WARNING ] MonitorFlags: VCCINT 2.994 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 15:30:11 [WARNING ] MonitorFlags: VCCAUX 2.994 out of range 2.400 to 2.60 on hostaname lwa22, chip 1
2014-02-26 15:30:11 [CRITICAL] MonitorFlags: Temperature 218.00 > 90 on hostname lwa22, chip 2, Shutting down all FPGA's
2014-02-26 15:30:11 [WARNING ] MonitorFlags: VCCINT 0.328 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2014-02-26 15:30:11 [WARNING ] MonitorFlags: VCCAUX 0.328 out of range 2.400 to 2.60 on hostaname lwa22, chip 2
2014-02-26 15:30:11 [CRITICAL] MonitorFlags: Temperature 218.00 > 90 on hostname lwa22, chip 3, Shutting down all FPGA's
2014-02-26 15:30:11 [WARNING ] MonitorFlags: VCCINT 0.328 out of range 0.987 to 1.04 on hostname lwa22, chip 3
2014-02-26 15:30:11 [WARNING ] MonitorFlags: VCCAUX 0.328 out of range 2.400 to 2.60 on hostaname lwa22, chip 3
2014-02-26 15:30:11 [CRITICAL] MonitorFlags: Temperature 218.00 > 90 on hostname lwa22, chip 4, Shutting down all FPGA's
2014-02-26 15:30:11 [WARNING ] MonitorFlags: VCCINT 0.328 out of range 0.987 to 1.04 on hostname lwa22, chip 4
2014-02-26 15:30:11 [WARNING ] MonitorFlags: VCCAUX 0.328 out of range 2.400 to 2.60 on hostaname lwa22, chip 4
2014-02-26 15:30:11 [CRITICAL] MonitorFlags: Temperature 218.00 > 90 on hostname lwa22, chip 5, Shutting down all FPGA's
2014-02-26 15:30:11 [WARNING ] MonitorFlags: VCCINT 0.328 out of range 0.987 to 1.04 on hostname lwa22, chip 5
2014-02-26 15:30:11 [WARNING ] MonitorFlags: VCCAUX 0.328 out of range 2.400 to 2.60 on hostaname lwa22, chip 5
2014-02-26 15:30:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 1, top port
2014-02-26 15:30:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 1, bottom port
2014-02-26 15:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 3465141
2014-02-26 15:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 3465141
2014-02-26 15:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 3465141
2014-02-26 15:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 3465141
2014-02-26 15:30:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 5, bottom port
2014-02-26 15:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 3465141
2014-02-26 15:30:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 1, top port
2014-02-26 15:30:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 1, bottom port
2014-02-26 15:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 3465141
2014-02-26 15:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 3465141
2014-02-26 15:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 3465141
2014-02-26 15:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 3465141
2014-02-26 15:30:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 5, top port
2014-02-26 15:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 1, top port
2014-02-26 15:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 1, bottom port
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 5, top port
2014-02-26 15:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 5, bottom port
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2014-02-26 15:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 1, top port
2014-02-26 15:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 1, bottom port
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 5, top port
2014-02-26 15:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 5, bottom port
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 1, top port
2014-02-26 15:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 1, bottom port
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 5, top port
2014-02-26 15:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 5, bottom port
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 1, top port
2014-02-26 15:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 1, bottom port
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 5, top port
2014-02-26 15:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 5, bottom port
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 1, top port
2014-02-26 15:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 1, bottom port
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 5, bottom port
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 1, top port
2014-02-26 15:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 1, bottom port
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 5, top port
2014-02-26 15:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 5, bottom port
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 1, top port
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, top port
2014-02-26 15:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 1, top port
2014-02-26 15:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 1, bottom port
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 5, top port
2014-02-26 15:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 5, bottom port
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 1, top port
2014-02-26 15:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 1, bottom port
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 3465141
2014-02-26 15:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 5, top port
2014-02-26 15:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 5, bottom port
2014-02-26 15:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 3465141
2014-02-26 15:30:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 1, top port
2014-02-26 15:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 3465141
2014-02-26 15:30:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 2, top port
2014-02-26 15:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 3465141
2014-02-26 15:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 3465141
2014-02-26 15:30:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 4, bottom port
2014-02-26 15:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 3465141
2014-02-26 15:30:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 5, bottom port
2014-02-26 15:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 3465141
2014-02-26 15:30:54 [CRITICAL] MGT underflow detected on beam(s) 2, 4, 3, 1
2014-02-26 15:30:54 [CRITICAL] Found only 27 boards due to thermal shutdown, need 28
2014-02-26 15:30:54 [DEBUG   ] Stopping antenna statistics
2014-02-26 15:30:54 [WARNING ] AntennaStats: no access to lwa28
2014-02-26 15:30:54 [WARNING ] AntennaStats: last command was /usr/local/bin/lwa28 /lwa/software/amplitude
2014-02-26 15:30:54 [WARNING ] AntennaStats: last command output as 
2014-02-26 15:30:54 [DEBUG   ] Finished updating ant stats in 43.987 seconds
2014-02-26 15:30:54 [DEBUG   ] Finished updating board flags in 44.252 seconds
2014-02-26 15:30:55 [DEBUG   ] Stopping beam statistics
2014-02-26 15:30:55 [DEBUG   ] Stopping monitoring flags
2014-02-26 15:30:55 [DEBUG   ] Stopping BAM updater
2014-02-26 15:30:55 [DEBUG   ] Stopping DRX time setter
2014-02-26 15:30:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh with timeout 10 s
2014-02-26 15:30:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh with timeout 10 s
2014-02-26 15:30:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh with timeout 10 s
2014-02-26 15:30:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh with timeout 10 s
2014-02-26 15:30:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh with timeout 10 s
2014-02-26 15:30:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh with timeout 10 s
2014-02-26 15:30:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh with timeout 10 s
2014-02-26 15:30:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh with timeout 10 s
2014-02-26 15:30:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh with timeout 10 s
2014-02-26 15:30:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh with timeout 10 s
2014-02-26 15:30:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh with timeout 10 s
2014-02-26 15:30:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh with timeout 10 s
2014-02-26 15:31:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh with timeout 10 s
2014-02-26 15:31:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh with timeout 10 s
2014-02-26 15:31:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh with timeout 10 s
2014-02-26 15:31:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh with timeout 10 s
2014-02-26 15:31:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh with timeout 10 s
2014-02-26 15:31:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh with timeout 10 s
2014-02-26 15:31:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh with timeout 10 s
2014-02-26 15:31:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh with timeout 10 s
2014-02-26 15:31:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh with timeout 10 s
2014-02-26 15:31:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh with timeout 10 s
2014-02-26 15:31:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh with timeout 10 s
2014-02-26 15:31:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh with timeout 10 s
2014-02-26 15:31:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh with timeout 10 s
2014-02-26 15:31:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh with timeout 10 s
2014-02-26 15:31:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh with timeout 10 s
2014-02-26 15:31:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh with timeout 10 s
2014-02-26 15:31:06 [DEBUG   ] run_process: at 2014-02-26 15:31:06 running ['/usr/local/bin/lwa16', '/lwa/software/Shutdown.sh']
2014-02-26 15:31:06 [DEBUG   ] run_process: at 2014-02-26 15:31:06 running ['/usr/local/bin/lwa27', '/lwa/software/Shutdown.sh']
2014-02-26 15:31:06 [DEBUG   ] run_process: at 2014-02-26 15:31:06 running ['/usr/local/bin/lwa24', '/lwa/software/Shutdown.sh']
2014-02-26 15:31:06 [DEBUG   ] run_process: at 2014-02-26 15:31:06 running ['/usr/local/bin/lwa23', '/lwa/software/Shutdown.sh']
2014-02-26 15:31:06 [DEBUG   ] run_process: at 2014-02-26 15:31:06 running ['/usr/local/bin/lwa18', '/lwa/software/Shutdown.sh']
2014-02-26 15:31:06 [DEBUG   ] run_process: at 2014-02-26 15:31:06 running ['/usr/local/bin/lwa10', '/lwa/software/Shutdown.sh']
2014-02-26 15:31:06 [DEBUG   ] run_process: at 2014-02-26 15:31:06 running ['/usr/local/bin/lwa32', '/lwa/software/Shutdown.sh']
2014-02-26 15:31:06 [DEBUG   ] run_process: at 2014-02-26 15:31:06 running ['/usr/local/bin/lwa11', '/lwa/software/Shutdown.sh']
2014-02-26 15:31:07 [DEBUG   ] run_process: at 2014-02-26 15:31:07 running ['/usr/local/bin/lwa30', '/lwa/software/Shutdown.sh']
2014-02-26 15:31:07 [DEBUG   ] run_process: at 2014-02-26 15:31:07 running ['/usr/local/bin/lwa12', '/lwa/software/Shutdown.sh']
2014-02-26 15:31:07 [DEBUG   ] run_process: at 2014-02-26 15:31:07 running ['/usr/local/bin/lwa8', '/lwa/software/Shutdown.sh']
2014-02-26 15:31:07 [DEBUG   ] run_process: at 2014-02-26 15:31:07 running ['/usr/local/bin/lwa13', '/lwa/software/Shutdown.sh']
2014-02-26 15:31:07 [DEBUG   ] run_process: at 2014-02-26 15:31:07 running ['/usr/local/bin/lwa26', '/lwa/software/Shutdown.sh']
2014-02-26 15:31:07 [DEBUG   ] run_process: at 2014-02-26 15:31:07 running ['/usr/local/bin/lwa14', '/lwa/software/Shutdown.sh']
2014-02-26 15:31:07 [DEBUG   ] run_process: at 2014-02-26 15:31:07 running ['/usr/local/bin/lwa34', '/lwa/software/Shutdown.sh']
2014-02-26 15:31:07 [DEBUG   ] run_process: at 2014-02-26 15:31:07 running ['/usr/local/bin/lwa22', '/lwa/software/Shutdown.sh']
2014-02-26 15:31:07 [DEBUG   ] run_process: at 2014-02-26 15:31:07 running ['/usr/local/bin/lwa20', '/lwa/software/Shutdown.sh']
2014-02-26 15:31:08 [DEBUG   ] run_process: at 2014-02-26 15:31:08 running ['/usr/local/bin/lwa1', '/lwa/software/Shutdown.sh']
2014-02-26 15:31:08 [DEBUG   ] run_process: at 2014-02-26 15:31:08 running ['/usr/local/bin/lwa5', '/lwa/software/Shutdown.sh']
2014-02-26 15:31:08 [DEBUG   ] run_process: at 2014-02-26 15:31:08 running ['/usr/local/bin/lwa25', '/lwa/software/Shutdown.sh']
2014-02-26 15:31:08 [DEBUG   ] run_process: at 2014-02-26 15:31:08 running ['/usr/local/bin/lwa35', '/lwa/software/Shutdown.sh']
2014-02-26 15:31:08 [DEBUG   ] run_process: at 2014-02-26 15:31:08 running ['/usr/local/bin/lwa19', '/lwa/software/Shutdown.sh']
2014-02-26 15:31:08 [DEBUG   ] run_process: at 2014-02-26 15:31:08 running ['/usr/local/bin/lwa21', '/lwa/software/Shutdown.sh']
2014-02-26 15:31:08 [DEBUG   ] run_process: at 2014-02-26 15:31:08 running ['/usr/local/bin/lwa6', '/lwa/software/Shutdown.sh']
2014-02-26 15:31:08 [DEBUG   ] run_process: at 2014-02-26 15:31:08 running ['/usr/local/bin/lwa7', '/lwa/software/Shutdown.sh']
2014-02-26 15:31:08 [DEBUG   ] run_process: at 2014-02-26 15:31:08 running ['/usr/local/bin/lwa33', '/lwa/software/Shutdown.sh']
2014-02-26 15:31:09 [DEBUG   ] run_process: at 2014-02-26 15:31:09 running ['/usr/local/bin/lwa15', '/lwa/software/Shutdown.sh']
2014-02-26 15:31:09 [DEBUG   ] run_process: at 2014-02-26 15:31:09 running ['/usr/local/bin/lwa28', '/lwa/software/Shutdown.sh']
2014-02-26 15:31:09 [INFO    ] Finished the SHT process in 15.001 s
2014-02-26 15:32:35 [DEBUG   ] Got command RPT from MCS: ref #286102
2014-02-26 15:32:35 [DEBUG   ] summary = SHUTDWN
2014-02-26 15:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286102  15 56714 55955478 ASHUTDWNSHUTDWN'
2014-02-26 15:32:35 [DEBUG   ] Got command RPT from MCS: ref #286103
2014-02-26 15:32:35 [DEBUG   ] info = System has been shut down
2014-02-26 15:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286103  33 56714 55955478 ASHUTDWNSystem has been shut down'
2014-02-26 15:37:35 [DEBUG   ] Got command RPT from MCS: ref #286119
2014-02-26 15:37:35 [DEBUG   ] summary = SHUTDWN
2014-02-26 15:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286119  15 56714 56255486 ASHUTDWNSHUTDWN'
2014-02-26 15:37:35 [DEBUG   ] Got command RPT from MCS: ref #286120
2014-02-26 15:37:35 [DEBUG   ] info = System has been shut down
2014-02-26 15:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286120  33 56714 56255486 ASHUTDWNSystem has been shut down'
2014-02-26 15:42:35 [DEBUG   ] Got command RPT from MCS: ref #286136
2014-02-26 15:42:35 [DEBUG   ] summary = SHUTDWN
2014-02-26 15:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286136  15 56714 56555486 ASHUTDWNSHUTDWN'
2014-02-26 15:42:35 [DEBUG   ] Got command RPT from MCS: ref #286137
2014-02-26 15:42:35 [DEBUG   ] info = System has been shut down
2014-02-26 15:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286137  33 56714 56555486 ASHUTDWNSystem has been shut down'
2014-02-26 15:47:35 [DEBUG   ] Got command RPT from MCS: ref #286153
2014-02-26 15:47:35 [DEBUG   ] summary = SHUTDWN
2014-02-26 15:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286153  15 56714 56855478 ASHUTDWNSHUTDWN'
2014-02-26 15:47:35 [DEBUG   ] Got command RPT from MCS: ref #286154
2014-02-26 15:47:35 [DEBUG   ] info = System has been shut down
2014-02-26 15:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286154  33 56714 56855478 ASHUTDWNSystem has been shut down'
2014-02-26 15:52:35 [DEBUG   ] Got command RPT from MCS: ref #286170
2014-02-26 15:52:35 [DEBUG   ] summary = SHUTDWN
2014-02-26 15:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286170  15 56714 57155486 ASHUTDWNSHUTDWN'
2014-02-26 15:52:35 [DEBUG   ] Got command RPT from MCS: ref #286171
2014-02-26 15:52:35 [DEBUG   ] info = System has been shut down
2014-02-26 15:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286171  33 56714 57155486 ASHUTDWNSystem has been shut down'
2014-02-26 15:57:35 [DEBUG   ] Got command RPT from MCS: ref #286187
2014-02-26 15:57:35 [DEBUG   ] summary = SHUTDWN
2014-02-26 15:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286187  15 56714 57455486 ASHUTDWNSHUTDWN'
2014-02-26 15:57:35 [DEBUG   ] Got command RPT from MCS: ref #286188
2014-02-26 15:57:35 [DEBUG   ] info = System has been shut down
2014-02-26 15:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286188  33 56714 57455486 ASHUTDWNSystem has been shut down'
2014-02-26 16:02:35 [DEBUG   ] Got command RPT from MCS: ref #286204
2014-02-26 16:02:35 [DEBUG   ] summary = SHUTDWN
2014-02-26 16:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286204  15 56714 57755490 ASHUTDWNSHUTDWN'
2014-02-26 16:02:35 [DEBUG   ] Got command RPT from MCS: ref #286205
2014-02-26 16:02:35 [DEBUG   ] info = System has been shut down
2014-02-26 16:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286205  33 56714 57755490 ASHUTDWNSystem has been shut down'
2014-02-26 16:07:35 [DEBUG   ] Got command RPT from MCS: ref #286221
2014-02-26 16:07:35 [DEBUG   ] summary = SHUTDWN
2014-02-26 16:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286221  15 56714 58055494 ASHUTDWNSHUTDWN'
2014-02-26 16:07:35 [DEBUG   ] Got command RPT from MCS: ref #286222
2014-02-26 16:07:35 [DEBUG   ] info = System has been shut down
2014-02-26 16:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286222  33 56714 58055494 ASHUTDWNSystem has been shut down'
2014-02-26 16:12:35 [DEBUG   ] Got command RPT from MCS: ref #286238
2014-02-26 16:12:35 [DEBUG   ] summary = SHUTDWN
2014-02-26 16:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286238  15 56714 58355486 ASHUTDWNSHUTDWN'
2014-02-26 16:12:35 [DEBUG   ] Got command RPT from MCS: ref #286239
2014-02-26 16:12:35 [DEBUG   ] info = System has been shut down
2014-02-26 16:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286239  33 56714 58355486 ASHUTDWNSystem has been shut down'
2014-02-26 16:17:35 [DEBUG   ] Got command RPT from MCS: ref #286255
2014-02-26 16:17:35 [DEBUG   ] summary = SHUTDWN
2014-02-26 16:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286255  15 56714 58655490 ASHUTDWNSHUTDWN'
2014-02-26 16:17:35 [DEBUG   ] Got command RPT from MCS: ref #286256
2014-02-26 16:17:35 [DEBUG   ] info = System has been shut down
2014-02-26 16:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286256  33 56714 58655490 ASHUTDWNSystem has been shut down'
2014-02-26 16:22:35 [DEBUG   ] Got command RPT from MCS: ref #286272
2014-02-26 16:22:35 [DEBUG   ] summary = SHUTDWN
2014-02-26 16:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286272  15 56714 58955490 ASHUTDWNSHUTDWN'
2014-02-26 16:22:35 [DEBUG   ] Got command RPT from MCS: ref #286273
2014-02-26 16:22:35 [DEBUG   ] info = System has been shut down
2014-02-26 16:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286273  33 56714 58955490 ASHUTDWNSystem has been shut down'
2014-02-26 16:27:35 [DEBUG   ] Got command RPT from MCS: ref #286289
2014-02-26 16:27:35 [DEBUG   ] summary = SHUTDWN
2014-02-26 16:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286289  15 56714 59255490 ASHUTDWNSHUTDWN'
2014-02-26 16:27:35 [DEBUG   ] Got command RPT from MCS: ref #286290
2014-02-26 16:27:35 [DEBUG   ] info = System has been shut down
2014-02-26 16:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286290  33 56714 59255490 ASHUTDWNSystem has been shut down'
2014-02-26 16:32:35 [DEBUG   ] Got command RPT from MCS: ref #286306
2014-02-26 16:32:35 [DEBUG   ] summary = SHUTDWN
2014-02-26 16:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286306  15 56714 59555498 ASHUTDWNSHUTDWN'
2014-02-26 16:32:35 [DEBUG   ] Got command RPT from MCS: ref #286307
2014-02-26 16:32:35 [DEBUG   ] info = System has been shut down
2014-02-26 16:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286307  33 56714 59555498 ASHUTDWNSystem has been shut down'
2014-02-26 16:34:48 [DEBUG   ] Got command INI from MCS: ref #286323
2014-02-26 16:34:48 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2014-02-26 16:34:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   286323   8 56714 59688581 ABOOTING'
2014-02-26 16:35:07 [INFO    ] -------------------
2014-02-26 16:35:07 [INFO    ]  LWA board status
2014-02-26 16:35:07 [INFO    ] -------------------
2014-02-26 16:35:07 [INFO    ] DP 1: 2 lwa27
2014-02-26 16:35:07 [INFO    ] DP 1: 3 lwa24
2014-02-26 16:35:07 [INFO    ] DP 1: 4 lwa23
2014-02-26 16:35:07 [INFO    ] DP 1: 5 lwa18
2014-02-26 16:35:07 [INFO    ] DP 1: 6 lwa10
2014-02-26 16:35:07 [INFO    ] DP 1: 7 lwa32
2014-02-26 16:35:07 [INFO    ] DP 1: 8 lwa11
2014-02-26 16:35:07 [INFO    ] DP 1: 9 lwa30
2014-02-26 16:35:07 [INFO    ] DP 1: 10 lwa12
2014-02-26 16:35:07 [INFO    ] DP 1: 11 lwa8
2014-02-26 16:35:07 [INFO    ] DP 1: 12 lwa13
2014-02-26 16:35:07 [INFO    ] DP 1: 13 lwa26
2014-02-26 16:35:07 [INFO    ] DP 1: 14 lwa14
2014-02-26 16:35:07 [INFO    ] DP 1: 16 lwa22
2014-02-26 16:35:07 [INFO    ] DP 1: 17 lwa20
2014-02-26 16:35:07 [INFO    ] DP 1: 18 lwa1
2014-02-26 16:35:07 [INFO    ] DP 1: 19 lwa5
2014-02-26 16:35:07 [INFO    ] DP 1: 20 lwa25
2014-02-26 16:35:07 [INFO    ] DP 1: 21 lwa35
2014-02-26 16:35:07 [INFO    ] DP 1: 22 lwa19
2014-02-26 16:35:07 [INFO    ] DP 1: 23 lwa21
2014-02-26 16:35:07 [INFO    ] DP 1: 24 lwa6
2014-02-26 16:35:07 [INFO    ] DP 1: 25 lwa7
2014-02-26 16:35:07 [INFO    ] DP 1: 26 lwa33
2014-02-26 16:35:07 [INFO    ] DP 1: 27 lwa15
2014-02-26 16:35:07 [INFO    ] DP 1: 28 lwa28
2014-02-26 16:35:07 [INFO    ] DP 2: 1 lwa16
2014-02-26 16:35:07 [INFO    ] DP 2: 15 lwa34
2014-02-26 16:35:07 [INFO    ] Total of 28 boards
2014-02-26 16:35:07 [INFO    ] Total of 260 stands
2014-02-26 16:35:07 [INFO    ] -------------------
2014-02-26 16:35:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2014-02-26 16:35:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2014-02-26 16:35:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2014-02-26 16:35:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2014-02-26 16:35:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2014-02-26 16:35:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2014-02-26 16:35:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2014-02-26 16:35:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2014-02-26 16:35:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2014-02-26 16:35:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2014-02-26 16:35:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2014-02-26 16:35:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2014-02-26 16:35:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2014-02-26 16:35:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2014-02-26 16:35:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2014-02-26 16:35:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2014-02-26 16:35:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2014-02-26 16:35:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2014-02-26 16:35:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2014-02-26 16:35:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2014-02-26 16:35:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2014-02-26 16:35:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2014-02-26 16:35:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2014-02-26 16:35:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2014-02-26 16:35:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2014-02-26 16:35:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2014-02-26 16:35:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2014-02-26 16:35:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2014-02-26 16:35:14 [DEBUG   ] 2014-02-26 16:35:14 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10922
2014-02-26 16:35:14 [DEBUG   ] 2014-02-26 16:35:14 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10923
2014-02-26 16:35:14 [DEBUG   ] 2014-02-26 16:35:14 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10924
2014-02-26 16:35:14 [DEBUG   ] 2014-02-26 16:35:14 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10925
2014-02-26 16:35:14 [DEBUG   ] 2014-02-26 16:35:14 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10926
2014-02-26 16:35:14 [DEBUG   ] 2014-02-26 16:35:14 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10927
2014-02-26 16:35:14 [DEBUG   ] 2014-02-26 16:35:14 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10928
2014-02-26 16:35:14 [DEBUG   ] 2014-02-26 16:35:14 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10929
2014-02-26 16:35:14 [DEBUG   ] 2014-02-26 16:35:14 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10930
2014-02-26 16:35:14 [DEBUG   ] 2014-02-26 16:35:14 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10931
2014-02-26 16:35:14 [DEBUG   ] 2014-02-26 16:35:14 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10932
2014-02-26 16:35:14 [DEBUG   ] 2014-02-26 16:35:14 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10933
2014-02-26 16:35:14 [DEBUG   ] 2014-02-26 16:35:14 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10934
2014-02-26 16:35:14 [DEBUG   ] 2014-02-26 16:35:14 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10935
2014-02-26 16:35:14 [DEBUG   ] 2014-02-26 16:35:14 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10936
2014-02-26 16:35:14 [DEBUG   ] 2014-02-26 16:35:14 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10937
2014-02-26 16:35:14 [DEBUG   ] 2014-02-26 16:35:14 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10938
2014-02-26 16:35:14 [DEBUG   ] 2014-02-26 16:35:14 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10939
2014-02-26 16:35:14 [DEBUG   ] 2014-02-26 16:35:14 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10940
2014-02-26 16:35:14 [DEBUG   ] 2014-02-26 16:35:14 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10941
2014-02-26 16:35:14 [DEBUG   ] 2014-02-26 16:35:14 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10942
2014-02-26 16:35:14 [DEBUG   ] 2014-02-26 16:35:14 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10943
2014-02-26 16:35:14 [DEBUG   ] 2014-02-26 16:35:14 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10944
2014-02-26 16:35:14 [DEBUG   ] 2014-02-26 16:35:14 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10945
2014-02-26 16:35:14 [DEBUG   ] 2014-02-26 16:35:14 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10946
2014-02-26 16:35:14 [DEBUG   ] 2014-02-26 16:35:14 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10947
2014-02-26 16:35:26 [DEBUG   ] 2014-02-26 16:35:26 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10922 exited with status 0
2014-02-26 16:35:26 [DEBUG   ] 2014-02-26 16:35:26 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10923 exited with status 0
2014-02-26 16:35:26 [DEBUG   ] 2014-02-26 16:35:26 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10924 exited with status 0
2014-02-26 16:35:26 [DEBUG   ] 2014-02-26 16:35:26 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10925 exited with status 0
2014-02-26 16:35:26 [DEBUG   ] 2014-02-26 16:35:26 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10926 exited with status 0
2014-02-26 16:35:26 [DEBUG   ] 2014-02-26 16:35:26 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10927 exited with status 0
2014-02-26 16:35:26 [DEBUG   ] 2014-02-26 16:35:26 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10928 exited with status 0
2014-02-26 16:35:26 [DEBUG   ] 2014-02-26 16:35:26 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10929 exited with status 0
2014-02-26 16:35:26 [DEBUG   ] 2014-02-26 16:35:26 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10930 exited with status 0
2014-02-26 16:35:26 [DEBUG   ] 2014-02-26 16:35:26 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10931 exited with status 0
2014-02-26 16:35:26 [DEBUG   ] 2014-02-26 16:35:26 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10932 exited with status 0
2014-02-26 16:35:26 [DEBUG   ] 2014-02-26 16:35:26 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10933 exited with status 0
2014-02-26 16:35:26 [DEBUG   ] 2014-02-26 16:35:26 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10934 exited with status 0
2014-02-26 16:35:26 [DEBUG   ] 2014-02-26 16:35:26 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10935 exited with status 0
2014-02-26 16:35:26 [DEBUG   ] 2014-02-26 16:35:26 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10936 exited with status 0
2014-02-26 16:35:26 [DEBUG   ] 2014-02-26 16:35:26 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10937 exited with status 0
2014-02-26 16:35:26 [DEBUG   ] 2014-02-26 16:35:26 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10938 exited with status 0
2014-02-26 16:35:26 [DEBUG   ] 2014-02-26 16:35:26 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10939 exited with status 0
2014-02-26 16:35:26 [DEBUG   ] 2014-02-26 16:35:26 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10940 exited with status 0
2014-02-26 16:35:26 [DEBUG   ] 2014-02-26 16:35:26 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10941 exited with status 0
2014-02-26 16:35:26 [DEBUG   ] 2014-02-26 16:35:26 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10942 exited with status 0
2014-02-26 16:35:26 [DEBUG   ] 2014-02-26 16:35:26 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10943 exited with status 0
2014-02-26 16:35:26 [DEBUG   ] 2014-02-26 16:35:26 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10944 exited with status 0
2014-02-26 16:35:26 [DEBUG   ] 2014-02-26 16:35:26 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10945 exited with status 0
2014-02-26 16:35:26 [DEBUG   ] 2014-02-26 16:35:26 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10946 exited with status 0
2014-02-26 16:35:26 [DEBUG   ] 2014-02-26 16:35:26 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10947 exited with status 0
2014-02-26 16:35:26 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2014-02-26 16:35:26 [DEBUG   ] spawn_process: at 2014-02-26 16:35:26 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2014-02-26 16:35:26 [DEBUG   ] spawn_process: at 2014-02-26 16:35:26 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2014-02-26 16:35:26 [DEBUG   ] spawn_process: at 2014-02-26 16:35:26 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2014-02-26 16:35:26 [DEBUG   ] spawn_process: at 2014-02-26 16:35:26 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2014-02-26 16:35:26 [DEBUG   ] spawn_process: at 2014-02-26 16:35:26 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2014-02-26 16:35:26 [DEBUG   ] spawn_process: at 2014-02-26 16:35:26 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2014-02-26 16:35:26 [DEBUG   ] spawn_process: at 2014-02-26 16:35:26 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2014-02-26 16:35:26 [DEBUG   ] spawn_process: at 2014-02-26 16:35:26 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2014-02-26 16:35:26 [DEBUG   ] spawn_process: at 2014-02-26 16:35:26 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2014-02-26 16:35:26 [DEBUG   ] spawn_process: at 2014-02-26 16:35:26 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2014-02-26 16:35:26 [DEBUG   ] spawn_process: at 2014-02-26 16:35:26 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2014-02-26 16:35:26 [DEBUG   ] spawn_process: at 2014-02-26 16:35:26 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2014-02-26 16:35:26 [DEBUG   ] spawn_process: at 2014-02-26 16:35:26 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2014-02-26 16:35:26 [DEBUG   ] spawn_process: at 2014-02-26 16:35:26 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2014-02-26 16:35:26 [DEBUG   ] spawn_process: at 2014-02-26 16:35:26 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2014-02-26 16:35:26 [DEBUG   ] spawn_process: at 2014-02-26 16:35:26 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2014-02-26 16:35:26 [DEBUG   ] spawn_process: at 2014-02-26 16:35:26 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2014-02-26 16:35:26 [DEBUG   ] spawn_process: at 2014-02-26 16:35:26 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2014-02-26 16:35:26 [DEBUG   ] spawn_process: at 2014-02-26 16:35:26 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2014-02-26 16:35:26 [DEBUG   ] spawn_process: at 2014-02-26 16:35:26 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2014-02-26 16:35:26 [DEBUG   ] spawn_process: at 2014-02-26 16:35:26 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2014-02-26 16:35:26 [DEBUG   ] spawn_process: at 2014-02-26 16:35:26 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2014-02-26 16:35:26 [DEBUG   ] spawn_process: at 2014-02-26 16:35:26 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2014-02-26 16:35:26 [DEBUG   ] spawn_process: at 2014-02-26 16:35:26 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2014-02-26 16:35:26 [DEBUG   ] spawn_process: at 2014-02-26 16:35:26 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2014-02-26 16:35:26 [DEBUG   ] spawn_process: at 2014-02-26 16:35:26 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2014-02-26 16:35:26 [DEBUG   ] 2014-02-26 16:35:26 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 10974
2014-02-26 16:35:26 [DEBUG   ] 2014-02-26 16:35:26 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 10975
2014-02-26 16:35:32 [DEBUG   ] 2014-02-26 16:35:32 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 10974 exited with status 0
2014-02-26 16:35:32 [DEBUG   ] 2014-02-26 16:35:32 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 10975 exited with status 0
2014-02-26 16:35:32 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2014-02-26 16:35:32 [DEBUG   ] spawn_process: at 2014-02-26 16:35:32 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2014-02-26 16:35:32 [DEBUG   ] spawn_process: at 2014-02-26 16:35:32 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2014-02-26 16:35:32 [INFO    ] Setting Beam 1 xbars
2014-02-26 16:35:32 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2014-02-26 16:35:32 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2014-02-26 16:35:32 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2014-02-26 16:35:32 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2014-02-26 16:35:32 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2014-02-26 16:35:33 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2014-02-26 16:35:33 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2014-02-26 16:35:33 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2014-02-26 16:35:33 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2014-02-26 16:35:33 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2014-02-26 16:35:33 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2014-02-26 16:35:33 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2014-02-26 16:35:33 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2014-02-26 16:35:33 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2014-02-26 16:35:34 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2014-02-26 16:35:34 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2014-02-26 16:35:34 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2014-02-26 16:35:34 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2014-02-26 16:35:34 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2014-02-26 16:35:34 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2014-02-26 16:35:34 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2014-02-26 16:35:34 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2014-02-26 16:35:34 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2014-02-26 16:35:35 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2014-02-26 16:35:35 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2014-02-26 16:35:35 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2014-02-26 16:35:35 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2014-02-26 16:35:35 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2014-02-26 16:35:35 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2014-02-26 16:35:35 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2014-02-26 16:35:35 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2014-02-26 16:35:35 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2014-02-26 16:35:36 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2014-02-26 16:35:36 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2014-02-26 16:35:36 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2014-02-26 16:35:36 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2014-02-26 16:35:36 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2014-02-26 16:35:36 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2014-02-26 16:35:36 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2014-02-26 16:35:36 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2014-02-26 16:35:36 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2014-02-26 16:35:36 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2014-02-26 16:35:37 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2014-02-26 16:35:37 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2014-02-26 16:35:37 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2014-02-26 16:35:37 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2014-02-26 16:35:37 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2014-02-26 16:35:37 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2014-02-26 16:35:37 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2014-02-26 16:35:37 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2014-02-26 16:35:37 [INFO    ] Setting Beam 2 xbars
2014-02-26 16:35:37 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2014-02-26 16:35:38 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2014-02-26 16:35:38 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2014-02-26 16:35:38 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2014-02-26 16:35:38 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2014-02-26 16:35:38 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2014-02-26 16:35:38 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2014-02-26 16:35:38 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2014-02-26 16:35:38 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2014-02-26 16:35:38 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2014-02-26 16:35:39 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2014-02-26 16:35:39 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2014-02-26 16:35:39 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2014-02-26 16:35:39 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2014-02-26 16:35:39 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2014-02-26 16:35:39 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2014-02-26 16:35:39 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2014-02-26 16:35:39 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2014-02-26 16:35:39 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2014-02-26 16:35:40 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2014-02-26 16:35:40 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2014-02-26 16:35:40 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2014-02-26 16:35:40 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2014-02-26 16:35:40 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2014-02-26 16:35:40 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2014-02-26 16:35:40 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2014-02-26 16:35:40 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2014-02-26 16:35:40 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2014-02-26 16:35:40 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2014-02-26 16:35:41 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2014-02-26 16:35:41 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2014-02-26 16:35:41 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2014-02-26 16:35:41 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2014-02-26 16:35:41 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2014-02-26 16:35:41 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2014-02-26 16:35:41 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2014-02-26 16:35:41 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2014-02-26 16:35:41 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2014-02-26 16:35:42 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2014-02-26 16:35:42 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2014-02-26 16:35:42 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2014-02-26 16:35:42 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2014-02-26 16:35:42 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2014-02-26 16:35:42 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2014-02-26 16:35:42 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2014-02-26 16:35:42 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2014-02-26 16:35:42 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2014-02-26 16:35:43 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2014-02-26 16:35:43 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2014-02-26 16:35:43 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2014-02-26 16:35:43 [INFO    ] Setting Beam 3 xbars
2014-02-26 16:35:43 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2014-02-26 16:35:43 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2014-02-26 16:35:43 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2014-02-26 16:35:43 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2014-02-26 16:35:43 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2014-02-26 16:35:43 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2014-02-26 16:35:43 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2014-02-26 16:35:44 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2014-02-26 16:35:44 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2014-02-26 16:35:44 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2014-02-26 16:35:44 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2014-02-26 16:35:44 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2014-02-26 16:35:44 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2014-02-26 16:35:44 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2014-02-26 16:35:44 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2014-02-26 16:35:44 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2014-02-26 16:35:45 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2014-02-26 16:35:45 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2014-02-26 16:35:45 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2014-02-26 16:35:45 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2014-02-26 16:35:45 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2014-02-26 16:35:45 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2014-02-26 16:35:45 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2014-02-26 16:35:45 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2014-02-26 16:35:45 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2014-02-26 16:35:46 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2014-02-26 16:35:46 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2014-02-26 16:35:46 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2014-02-26 16:35:46 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2014-02-26 16:35:46 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2014-02-26 16:35:46 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2014-02-26 16:35:46 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2014-02-26 16:35:46 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2014-02-26 16:35:46 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2014-02-26 16:35:46 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2014-02-26 16:35:47 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2014-02-26 16:35:47 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2014-02-26 16:35:47 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2014-02-26 16:35:47 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2014-02-26 16:35:47 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2014-02-26 16:35:47 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2014-02-26 16:35:47 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2014-02-26 16:35:47 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2014-02-26 16:35:47 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2014-02-26 16:35:48 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2014-02-26 16:35:48 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2014-02-26 16:35:48 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2014-02-26 16:35:48 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2014-02-26 16:35:48 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2014-02-26 16:35:48 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2014-02-26 16:35:48 [INFO    ] Setting Beam 4 xbars
2014-02-26 16:35:48 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2014-02-26 16:35:48 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2014-02-26 16:35:48 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2014-02-26 16:35:49 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2014-02-26 16:35:49 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2014-02-26 16:35:49 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2014-02-26 16:35:49 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2014-02-26 16:35:49 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2014-02-26 16:35:49 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2014-02-26 16:35:49 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2014-02-26 16:35:49 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2014-02-26 16:35:49 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2014-02-26 16:35:50 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2014-02-26 16:35:50 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2014-02-26 16:35:50 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2014-02-26 16:35:50 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2014-02-26 16:35:50 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2014-02-26 16:35:50 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2014-02-26 16:35:50 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2014-02-26 16:35:50 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2014-02-26 16:35:50 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2014-02-26 16:35:50 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2014-02-26 16:35:51 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2014-02-26 16:35:51 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2014-02-26 16:35:51 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2014-02-26 16:35:51 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2014-02-26 16:35:51 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2014-02-26 16:35:51 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2014-02-26 16:35:51 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2014-02-26 16:35:51 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2014-02-26 16:35:51 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2014-02-26 16:35:52 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2014-02-26 16:35:52 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2014-02-26 16:35:52 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2014-02-26 16:35:52 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2014-02-26 16:35:52 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2014-02-26 16:35:52 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2014-02-26 16:35:52 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2014-02-26 16:35:52 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2014-02-26 16:35:52 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2014-02-26 16:35:53 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2014-02-26 16:35:53 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2014-02-26 16:35:53 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2014-02-26 16:35:53 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2014-02-26 16:35:53 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2014-02-26 16:35:53 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2014-02-26 16:35:53 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2014-02-26 16:35:53 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2014-02-26 16:35:53 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2014-02-26 16:35:54 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2014-02-26 16:35:54 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2014-02-26 16:35:54 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2014-02-26 16:35:54 [INFO    ] All xbars set
2014-02-26 16:35:54 [INFO    ] Setting adder chain routing for all beams
2014-02-26 16:35:59 [INFO    ] Setting beam ids
2014-02-26 16:36:09 [INFO    ] Starting beam delay calibration
2014-02-26 16:36:21 [INFO    ] Beam 1 latency is 5722
2014-02-26 16:36:21 [INFO    ] Beam 2 latency is 5742
2014-02-26 16:36:21 [INFO    ] Beam 3 latency is 5735
2014-02-26 16:36:21 [INFO    ] Beam 4 latency is 5721
2014-02-26 16:36:21 [INFO    ] Stop calibration
2014-02-26 16:36:29 [INFO    ] Beam delay calibration successful
2014-02-26 16:36:29 [INFO    ] Calibration passed
2014-02-26 16:36:29 [DEBUG   ] spawn_process: at 2014-02-26 16:36:29 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2014-02-26 16:36:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2014-02-26 16:36:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2014-02-26 16:36:29 [DEBUG   ] spawn_process: at 2014-02-26 16:36:29 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2014-02-26 16:36:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2014-02-26 16:36:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2014-02-26 16:36:29 [DEBUG   ] spawn_process: at 2014-02-26 16:36:29 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2014-02-26 16:36:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2014-02-26 16:36:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2014-02-26 16:36:29 [DEBUG   ] spawn_process: at 2014-02-26 16:36:29 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2014-02-26 16:36:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2014-02-26 16:36:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2014-02-26 16:36:29 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2014-02-26 16:36:29 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 516 ms (1393432589.517 s) with PID 12540 and time 1393432590
2014-02-26 16:36:29 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2014-02-26 16:36:30 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 290 ms (1393432590.291 s) with PID 12562 and time 1393432591
2014-02-26 16:36:31 [DEBUG   ] Finished updating ant stats in 0.955 seconds
2014-02-26 16:36:31 [INFO    ] Started antennas statistics background thread
2014-02-26 16:36:31 [INFO    ] Started board flags background thread
2014-02-26 16:36:31 [INFO    ] Started BAM background thread
2014-02-26 16:36:31 [INFO    ] Finished the INI process (ref. #286323) in 102.832 s
2014-02-26 16:36:32 [DEBUG   ] Finished updating board flags in 1.132 seconds
2014-02-26 16:36:51 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 16:37:02 [DEBUG   ] Got command RPT from MCS: ref #286324
2014-02-26 16:37:02 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 16:37:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286324  48 56714 59822830 A NORMALSystem calibrated and operating normally'
2014-02-26 16:37:11 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 16:37:12 [DEBUG   ] Got command TBN from MCS: ref #286325
2014-02-26 16:37:12 [DEBUG   ] spawn_process: at 2014-02-26 16:37:12 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '1', '1393432634']
2014-02-26 16:37:12 [DEBUG   ] spawn_process: at 2014-02-26 16:37:12 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '2', '1393432634']
2014-02-26 16:37:12 [DEBUG   ] tbn = exited with status True, code 0x00
2014-02-26 16:37:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   286325   8 56714 59832934 A NORMAL'
2014-02-26 16:37:12 [DEBUG   ] spawn_process: at 2014-02-26 16:37:12 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '3', '1393432634']
2014-02-26 16:37:12 [DEBUG   ] spawn_process: at 2014-02-26 16:37:12 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '4', '1393432634']
2014-02-26 16:37:12 [DEBUG   ] spawn_process: at 2014-02-26 16:37:12 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '5', '1393432634']
2014-02-26 16:37:12 [DEBUG   ] spawn_process: at 2014-02-26 16:37:12 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '6', '1393432634']
2014-02-26 16:37:12 [DEBUG   ] spawn_process: at 2014-02-26 16:37:12 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '7', '1393432634']
2014-02-26 16:37:12 [DEBUG   ] spawn_process: at 2014-02-26 16:37:12 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '8', '1393432634']
2014-02-26 16:37:12 [DEBUG   ] spawn_process: at 2014-02-26 16:37:12 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '9', '1393432634']
2014-02-26 16:37:12 [DEBUG   ] spawn_process: at 2014-02-26 16:37:12 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '10', '1393432634']
2014-02-26 16:37:12 [DEBUG   ] spawn_process: at 2014-02-26 16:37:12 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '11', '1393432634']
2014-02-26 16:37:12 [DEBUG   ] spawn_process: at 2014-02-26 16:37:12 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '12', '1393432634']
2014-02-26 16:37:12 [DEBUG   ] spawn_process: at 2014-02-26 16:37:12 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '13', '1393432634']
2014-02-26 16:37:12 [DEBUG   ] spawn_process: at 2014-02-26 16:37:12 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '14', '1393432634']
2014-02-26 16:37:12 [DEBUG   ] spawn_process: at 2014-02-26 16:37:12 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '15', '1393432634']
2014-02-26 16:37:12 [DEBUG   ] spawn_process: at 2014-02-26 16:37:12 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '16', '1393432634']
2014-02-26 16:37:12 [DEBUG   ] spawn_process: at 2014-02-26 16:37:12 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '17', '1393432634']
2014-02-26 16:37:12 [DEBUG   ] spawn_process: at 2014-02-26 16:37:12 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '18', '1393432634']
2014-02-26 16:37:12 [DEBUG   ] spawn_process: at 2014-02-26 16:37:12 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '19', '1393432634']
2014-02-26 16:37:12 [DEBUG   ] spawn_process: at 2014-02-26 16:37:12 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '20', '1393432634']
2014-02-26 16:37:12 [DEBUG   ] spawn_process: at 2014-02-26 16:37:12 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '21', '1393432634']
2014-02-26 16:37:12 [DEBUG   ] spawn_process: at 2014-02-26 16:37:12 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '22', '1393432634']
2014-02-26 16:37:12 [DEBUG   ] spawn_process: at 2014-02-26 16:37:12 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '23', '1393432634']
2014-02-26 16:37:12 [DEBUG   ] spawn_process: at 2014-02-26 16:37:12 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '24', '1393432634']
2014-02-26 16:37:12 [DEBUG   ] spawn_process: at 2014-02-26 16:37:12 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '25', '1393432634']
2014-02-26 16:37:12 [DEBUG   ] spawn_process: at 2014-02-26 16:37:12 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '26', '1393432634']
2014-02-26 16:37:12 [INFO    ] Finished spawning TBN in 0.047 s
2014-02-26 16:37:31 [DEBUG   ] Finished updating ant stats in 0.869 seconds
2014-02-26 16:37:32 [DEBUG   ] Finished updating board flags in 1.345 seconds
2014-02-26 16:37:35 [DEBUG   ] Got command RPT from MCS: ref #286326
2014-02-26 16:37:35 [DEBUG   ] summary = NORMAL
2014-02-26 16:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286326  14 56714 59855497 A NORMALNORMAL'
2014-02-26 16:37:35 [DEBUG   ] Got command RPT from MCS: ref #286327
2014-02-26 16:37:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 16:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286327  48 56714 59855498 A NORMALSystem calibrated and operating normally'
2014-02-26 16:37:51 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 16:38:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 16:38:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 16:38:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2014-02-26 16:38:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 16:38:33 [DEBUG   ] Finished updating board flags in 2.082 seconds
2014-02-26 16:38:51 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 16:39:11 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 16:39:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 16:39:33 [DEBUG   ] Finished updating board flags in 2.014 seconds
2014-02-26 16:39:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 16:40:11 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 16:40:31 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 16:40:33 [DEBUG   ] Finished updating board flags in 2.107 seconds
2014-02-26 16:40:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 16:41:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 16:41:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 16:41:33 [DEBUG   ] Finished updating board flags in 1.871 seconds
2014-02-26 16:41:51 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-26 16:42:11 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-26 16:42:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 16:42:33 [DEBUG   ] Finished updating board flags in 1.825 seconds
2014-02-26 16:42:35 [DEBUG   ] Got command RPT from MCS: ref #286343
2014-02-26 16:42:35 [DEBUG   ] summary = NORMAL
2014-02-26 16:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286343  14 56714 60155501 A NORMALNORMAL'
2014-02-26 16:42:35 [DEBUG   ] Got command RPT from MCS: ref #286344
2014-02-26 16:42:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 16:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286344  48 56714 60155502 A NORMALSystem calibrated and operating normally'
2014-02-26 16:42:51 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 16:43:11 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 16:43:31 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 16:43:33 [DEBUG   ] Finished updating board flags in 1.782 seconds
2014-02-26 16:43:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 16:44:11 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 16:44:31 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-26 16:44:33 [DEBUG   ] Finished updating board flags in 1.619 seconds
2014-02-26 16:44:51 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2014-02-26 16:45:12 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-02-26 16:45:32 [DEBUG   ] Finished updating ant stats in 1.251 seconds
2014-02-26 16:45:33 [DEBUG   ] Finished updating board flags in 1.583 seconds
2014-02-26 16:45:52 [DEBUG   ] Finished updating ant stats in 1.158 seconds
2014-02-26 16:46:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 16:46:32 [DEBUG   ] Finished updating ant stats in 1.048 seconds
2014-02-26 16:46:33 [DEBUG   ] Finished updating board flags in 1.420 seconds
2014-02-26 16:46:52 [DEBUG   ] Finished updating ant stats in 0.956 seconds
2014-02-26 16:47:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 16:47:32 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2014-02-26 16:47:33 [DEBUG   ] Finished updating board flags in 1.391 seconds
2014-02-26 16:47:35 [DEBUG   ] Got command RPT from MCS: ref #286360
2014-02-26 16:47:35 [DEBUG   ] summary = NORMAL
2014-02-26 16:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286360  14 56714 60455493 A NORMALNORMAL'
2014-02-26 16:47:35 [DEBUG   ] Got command RPT from MCS: ref #286361
2014-02-26 16:47:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 16:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286361  48 56714 60455494 A NORMALSystem calibrated and operating normally'
2014-02-26 16:47:52 [DEBUG   ] Finished updating ant stats in 0.757 seconds
2014-02-26 16:48:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 16:48:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 16:48:33 [DEBUG   ] Finished updating board flags in 1.351 seconds
2014-02-26 16:48:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 16:49:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 16:49:32 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 16:49:34 [DEBUG   ] Finished updating board flags in 2.061 seconds
2014-02-26 16:49:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 16:50:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 16:50:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 16:50:34 [DEBUG   ] Finished updating board flags in 2.118 seconds
2014-02-26 16:50:52 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 16:51:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 16:51:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 16:51:34 [DEBUG   ] Finished updating board flags in 1.883 seconds
2014-02-26 16:51:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 16:52:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 16:52:32 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2014-02-26 16:52:34 [DEBUG   ] Finished updating board flags in 1.824 seconds
2014-02-26 16:52:35 [DEBUG   ] Got command RPT from MCS: ref #286377
2014-02-26 16:52:35 [DEBUG   ] summary = NORMAL
2014-02-26 16:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286377  14 56714 60755501 A NORMALNORMAL'
2014-02-26 16:52:35 [DEBUG   ] Got command RPT from MCS: ref #286378
2014-02-26 16:52:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 16:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286378  48 56714 60755502 A NORMALSystem calibrated and operating normally'
2014-02-26 16:52:53 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-02-26 16:53:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 16:53:33 [DEBUG   ] Finished updating ant stats in 1.253 seconds
2014-02-26 16:53:34 [DEBUG   ] Finished updating board flags in 1.773 seconds
2014-02-26 16:53:53 [DEBUG   ] Finished updating ant stats in 1.154 seconds
2014-02-26 16:54:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 16:54:33 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2014-02-26 16:54:34 [DEBUG   ] Finished updating board flags in 1.612 seconds
2014-02-26 16:54:53 [DEBUG   ] Finished updating ant stats in 0.958 seconds
2014-02-26 16:55:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 16:55:33 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2014-02-26 16:55:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 16:55:34 [DEBUG   ] Finished updating board flags in 1.610 seconds
2014-02-26 16:55:53 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2014-02-26 16:56:13 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2014-02-26 16:56:33 [DEBUG   ] Finished updating ant stats in 0.649 seconds
2014-02-26 16:56:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 16:56:34 [DEBUG   ] Finished updating board flags in 1.587 seconds
2014-02-26 16:56:53 [DEBUG   ] Finished updating ant stats in 0.553 seconds
2014-02-26 16:57:13 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2014-02-26 16:57:34 [DEBUG   ] Finished updating ant stats in 1.246 seconds
2014-02-26 16:57:34 [DEBUG   ] Finished updating board flags in 1.472 seconds
2014-02-26 16:57:35 [DEBUG   ] Got command RPT from MCS: ref #286394
2014-02-26 16:57:35 [DEBUG   ] summary = NORMAL
2014-02-26 16:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286394  14 56714 61055497 A NORMALNORMAL'
2014-02-26 16:57:35 [DEBUG   ] Got command RPT from MCS: ref #286395
2014-02-26 16:57:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 16:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286395  48 56714 61055498 A NORMALSystem calibrated and operating normally'
2014-02-26 16:57:54 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2014-02-26 16:58:14 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 16:58:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 16:58:34 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2014-02-26 16:58:34 [DEBUG   ] Finished updating board flags in 1.431 seconds
2014-02-26 16:58:54 [DEBUG   ] Finished updating ant stats in 0.958 seconds
2014-02-26 16:59:14 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 16:59:34 [DEBUG   ] Finished updating ant stats in 0.844 seconds
2014-02-26 16:59:34 [DEBUG   ] Finished updating board flags in 1.460 seconds
2014-02-26 16:59:54 [DEBUG   ] Finished updating ant stats in 0.762 seconds
2014-02-26 17:00:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2014-02-26 17:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2014-02-26 17:00:34 [DEBUG   ] Finished updating ant stats in 0.644 seconds
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2014-02-26 17:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2014-02-26 17:00:34 [DEBUG   ] Finished updating board flags in 1.466 seconds
2014-02-26 17:00:54 [DEBUG   ] Finished updating ant stats in 0.556 seconds
2014-02-26 17:01:14 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-02-26 17:01:34 [DEBUG   ] Finished updating ant stats in 0.448 seconds
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-02-26 17:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-02-26 17:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-02-26 17:01:35 [DEBUG   ] Finished updating board flags in 2.203 seconds
2014-02-26 17:01:55 [DEBUG   ] Finished updating ant stats in 1.359 seconds
2014-02-26 17:02:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 17:02:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 17:02:35 [DEBUG   ] Got command RPT from MCS: ref #286411
2014-02-26 17:02:35 [DEBUG   ] summary = NORMAL
2014-02-26 17:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286411  14 56714 61355506 A NORMALNORMAL'
2014-02-26 17:02:35 [DEBUG   ] Got command RPT from MCS: ref #286412
2014-02-26 17:02:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 17:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286412  48 56714 61355506 A NORMALSystem calibrated and operating normally'
2014-02-26 17:02:36 [DEBUG   ] Finished updating board flags in 3.192 seconds
2014-02-26 17:02:55 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 17:03:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 17:03:35 [DEBUG   ] Finished updating ant stats in 1.245 seconds
2014-02-26 17:03:35 [DEBUG   ] Finished updating board flags in 2.047 seconds
2014-02-26 17:03:55 [DEBUG   ] Finished updating ant stats in 1.158 seconds
2014-02-26 17:04:15 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 17:04:35 [DEBUG   ] Finished updating ant stats in 0.844 seconds
2014-02-26 17:04:35 [DEBUG   ] Finished updating board flags in 2.021 seconds
2014-02-26 17:04:55 [DEBUG   ] Finished updating ant stats in 0.759 seconds
2014-02-26 17:05:15 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-02-26 17:05:35 [DEBUG   ] Finished updating ant stats in 0.445 seconds
2014-02-26 17:05:35 [DEBUG   ] Finished updating board flags in 1.981 seconds
2014-02-26 17:05:56 [DEBUG   ] Finished updating ant stats in 1.355 seconds
2014-02-26 17:06:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 17:06:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 17:06:35 [DEBUG   ] Finished updating board flags in 1.805 seconds
2014-02-26 17:06:36 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 17:06:56 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-26 17:07:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 17:07:35 [DEBUG   ] Got command RPT from MCS: ref #286428
2014-02-26 17:07:35 [DEBUG   ] summary = NORMAL
2014-02-26 17:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286428  14 56714 61655506 A NORMALNORMAL'
2014-02-26 17:07:35 [DEBUG   ] Got command RPT from MCS: ref #286429
2014-02-26 17:07:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 17:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286429  48 56714 61655506 A NORMALSystem calibrated and operating normally'
2014-02-26 17:07:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 17:07:35 [DEBUG   ] Finished updating board flags in 1.807 seconds
2014-02-26 17:07:36 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-02-26 17:07:56 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 17:08:16 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 17:08:35 [DEBUG   ] Finished updating board flags in 1.782 seconds
2014-02-26 17:08:36 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-26 17:08:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 17:09:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 17:09:35 [DEBUG   ] Finished updating board flags in 1.621 seconds
2014-02-26 17:09:36 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 17:09:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 17:10:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 17:10:35 [DEBUG   ] Finished updating board flags in 1.591 seconds
2014-02-26 17:10:36 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 17:10:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 17:11:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 17:11:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2014-02-26 17:11:35 [DEBUG   ] Finished updating board flags in 1.361 seconds
2014-02-26 17:11:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 17:11:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 17:12:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 17:12:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-02-26 17:12:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2014-02-26 17:12:35 [DEBUG   ] Got command RPT from MCS: ref #286445
2014-02-26 17:12:35 [DEBUG   ] summary = NORMAL
2014-02-26 17:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286445  14 56714 61955506 A NORMALNORMAL'
2014-02-26 17:12:35 [DEBUG   ] Got command RPT from MCS: ref #286446
2014-02-26 17:12:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 17:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286446  48 56714 61955506 A NORMALSystem calibrated and operating normally'
2014-02-26 17:12:36 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 17:12:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2014-02-26 17:12:36 [CRITICAL] MGT underflow detected on beam(s) 1
2014-02-26 17:12:36 [DEBUG   ] Finished updating board flags in 2.065 seconds
2014-02-26 17:12:56 [DEBUG   ] Finished updating ant stats in 0.593 seconds
2014-02-26 17:13:16 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2014-02-26 17:13:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-02-26 17:13:36 [DEBUG   ] Finished updating board flags in 2.209 seconds
2014-02-26 17:13:37 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-02-26 17:13:57 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-26 17:14:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-26 17:14:36 [DEBUG   ] Finished updating board flags in 2.190 seconds
2014-02-26 17:14:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 17:14:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 17:15:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-26 17:15:36 [DEBUG   ] Finished updating board flags in 2.057 seconds
2014-02-26 17:15:37 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 17:15:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 17:16:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 17:16:36 [DEBUG   ] Finished updating board flags in 1.918 seconds
2014-02-26 17:16:37 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 17:16:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 17:17:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 17:17:35 [DEBUG   ] Got command RPT from MCS: ref #286462
2014-02-26 17:17:35 [DEBUG   ] summary = ERROR
2014-02-26 17:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286462  13 56714 62255502 A  ERRORERROR'
2014-02-26 17:17:35 [DEBUG   ] Got command RPT from MCS: ref #286463
2014-02-26 17:17:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 17:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286463  77 56714 62255502 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 17:17:36 [DEBUG   ] Finished updating board flags in 1.806 seconds
2014-02-26 17:17:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 17:17:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 17:18:17 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 17:18:36 [DEBUG   ] Finished updating board flags in 1.807 seconds
2014-02-26 17:18:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 17:18:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 17:19:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 17:19:36 [DEBUG   ] Finished updating board flags in 1.810 seconds
2014-02-26 17:19:37 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 17:19:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 17:20:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 17:20:36 [DEBUG   ] Finished updating board flags in 1.879 seconds
2014-02-26 17:20:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 17:20:57 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 17:21:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2014-02-26 17:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2014-02-26 17:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2014-02-26 17:21:36 [DEBUG   ] Finished updating board flags in 1.736 seconds
2014-02-26 17:21:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 17:21:57 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2014-02-26 17:22:17 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-02-26 17:22:35 [DEBUG   ] Got command RPT from MCS: ref #286479
2014-02-26 17:22:35 [DEBUG   ] summary = ERROR
2014-02-26 17:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286479  13 56714 62555506 A  ERRORERROR'
2014-02-26 17:22:35 [DEBUG   ] Got command RPT from MCS: ref #286480
2014-02-26 17:22:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 17:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286480  77 56714 62555506 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-02-26 17:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-02-26 17:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-02-26 17:22:36 [DEBUG   ] Finished updating board flags in 1.594 seconds
2014-02-26 17:22:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 17:22:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 17:23:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 17:23:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 17:23:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 17:23:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 17:23:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 17:23:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 17:23:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 17:23:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 17:23:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 17:23:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 17:23:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 17:23:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 17:23:36 [DEBUG   ] Finished updating board flags in 1.451 seconds
2014-02-26 17:23:37 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 17:23:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 17:24:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 17:24:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 17:24:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 17:24:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 17:24:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 17:24:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 17:24:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 17:24:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 17:24:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 17:24:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 17:24:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 17:24:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 17:24:37 [DEBUG   ] Finished updating board flags in 2.164 seconds
2014-02-26 17:24:57 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2014-02-26 17:25:17 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-02-26 17:25:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 17:25:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 17:25:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 17:25:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 17:25:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 17:25:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 17:25:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 17:25:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 17:25:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 17:25:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 17:25:37 [DEBUG   ] Finished updating board flags in 2.193 seconds
2014-02-26 17:25:38 [DEBUG   ] Finished updating ant stats in 1.392 seconds
2014-02-26 17:25:58 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2014-02-26 17:26:18 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 17:26:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 17:26:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 17:26:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 17:26:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 17:26:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 17:26:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 17:26:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 17:26:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 17:26:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 17:26:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 17:26:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-02-26 17:26:37 [DEBUG   ] Finished updating board flags in 1.969 seconds
2014-02-26 17:26:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 17:26:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 17:27:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 17:27:35 [DEBUG   ] Got command RPT from MCS: ref #286496
2014-02-26 17:27:35 [DEBUG   ] summary = ERROR
2014-02-26 17:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286496  13 56714 62855505 A  ERRORERROR'
2014-02-26 17:27:35 [DEBUG   ] Got command RPT from MCS: ref #286497
2014-02-26 17:27:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 17:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286497  77 56714 62855506 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 17:27:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 17:27:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 17:27:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 17:27:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 17:27:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 17:27:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 17:27:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 17:27:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 17:27:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 17:27:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 17:27:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 17:27:37 [DEBUG   ] Finished updating board flags in 1.825 seconds
2014-02-26 17:27:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 17:27:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 17:28:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 17:28:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 17:28:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 17:28:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 17:28:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 17:28:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 17:28:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 17:28:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 17:28:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 17:28:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 17:28:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 17:28:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 17:28:37 [DEBUG   ] Finished updating board flags in 1.824 seconds
2014-02-26 17:28:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 17:28:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 17:29:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 17:29:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 17:29:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 17:29:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 17:29:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 17:29:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 17:29:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 17:29:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 17:29:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 17:29:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 17:29:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 17:29:37 [DEBUG   ] Finished updating board flags in 1.836 seconds
2014-02-26 17:29:38 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 17:29:58 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2014-02-26 17:30:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 17:30:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 17:30:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 17:30:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 17:30:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 17:30:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 17:30:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 17:30:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 17:30:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 17:30:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 17:30:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 17:30:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 17:30:37 [DEBUG   ] Finished updating board flags in 1.747 seconds
2014-02-26 17:30:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 17:30:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 17:31:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 17:31:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 17:31:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 17:31:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 17:31:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 17:31:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 17:31:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 17:31:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 17:31:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 17:31:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 17:31:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 17:31:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-02-26 17:31:38 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 17:31:38 [DEBUG   ] Finished updating board flags in 2.263 seconds
2014-02-26 17:31:58 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-26 17:32:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 17:32:35 [DEBUG   ] Got command RPT from MCS: ref #286513
2014-02-26 17:32:35 [DEBUG   ] summary = ERROR
2014-02-26 17:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286513  13 56714 63155513 A  ERRORERROR'
2014-02-26 17:32:35 [DEBUG   ] Got command RPT from MCS: ref #286514
2014-02-26 17:32:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 17:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286514  77 56714 63155514 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 17:32:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 17:32:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 17:32:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 17:32:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 17:32:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 17:32:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 17:32:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 17:32:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 17:32:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 17:32:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 17:32:37 [DEBUG   ] Finished updating board flags in 1.500 seconds
2014-02-26 17:32:38 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2014-02-26 17:32:59 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-02-26 17:33:19 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-26 17:33:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 17:33:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 17:33:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 17:33:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 17:33:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 17:33:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 17:33:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 17:33:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 17:33:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 17:33:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 17:33:37 [DEBUG   ] Finished updating board flags in 1.390 seconds
2014-02-26 17:33:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-26 17:33:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 17:34:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 17:34:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 17:34:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 17:34:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 17:34:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 17:34:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 17:34:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 17:34:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 17:34:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 17:34:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 17:34:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 17:34:37 [DEBUG   ] Finished updating board flags in 1.373 seconds
2014-02-26 17:34:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-26 17:34:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 17:35:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 17:35:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 17:35:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 17:35:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 17:35:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 17:35:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 17:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 17:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 17:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 17:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 17:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 17:35:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 17:35:38 [DEBUG   ] Finished updating board flags in 2.079 seconds
2014-02-26 17:35:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 17:35:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-26 17:36:19 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2014-02-26 17:36:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 17:36:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 17:36:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 17:36:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 17:36:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 17:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 17:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 17:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 17:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 17:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 17:36:38 [DEBUG   ] Finished updating board flags in 2.000 seconds
2014-02-26 17:36:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 17:36:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 17:37:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 17:37:35 [DEBUG   ] Got command RPT from MCS: ref #286530
2014-02-26 17:37:35 [DEBUG   ] summary = ERROR
2014-02-26 17:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286530  13 56714 63455509 A  ERRORERROR'
2014-02-26 17:37:35 [DEBUG   ] Got command RPT from MCS: ref #286531
2014-02-26 17:37:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 17:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286531  77 56714 63455510 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 17:37:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 17:37:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 17:37:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 17:37:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 17:37:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 17:37:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 17:37:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 17:37:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 17:37:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 17:37:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 17:37:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 17:37:39 [DEBUG   ] Finished updating board flags in 2.913 seconds
2014-02-26 17:37:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 17:38:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 17:38:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 17:38:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 17:38:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 17:38:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 17:38:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 17:38:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 17:38:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 17:38:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 17:38:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 17:38:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 17:38:38 [DEBUG   ] Finished updating board flags in 1.936 seconds
2014-02-26 17:38:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 17:38:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 17:39:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 17:39:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 17:39:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 17:39:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 17:39:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 17:39:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 17:39:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 17:39:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 17:39:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 17:39:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 17:39:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 17:39:38 [DEBUG   ] Finished updating board flags in 1.778 seconds
2014-02-26 17:39:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 17:39:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 17:40:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 17:40:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 17:40:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 17:40:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 17:40:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 17:40:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 17:40:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 17:40:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 17:40:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 17:40:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 17:40:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 17:40:38 [DEBUG   ] Finished updating board flags in 1.611 seconds
2014-02-26 17:40:39 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-26 17:40:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 17:41:19 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 17:41:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 17:41:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 17:41:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 17:41:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 17:41:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 17:41:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 17:41:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 17:41:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 17:41:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 17:41:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 17:41:38 [DEBUG   ] Finished updating board flags in 1.569 seconds
2014-02-26 17:41:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 17:41:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-26 17:42:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 17:42:35 [DEBUG   ] Got command RPT from MCS: ref #286547
2014-02-26 17:42:35 [DEBUG   ] summary = ERROR
2014-02-26 17:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286547  13 56714 63755509 A  ERRORERROR'
2014-02-26 17:42:35 [DEBUG   ] Got command RPT from MCS: ref #286548
2014-02-26 17:42:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 17:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286548  77 56714 63755510 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 17:42:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 17:42:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 17:42:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 17:42:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 17:42:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 17:42:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 17:42:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 17:42:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 17:42:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 17:42:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 17:42:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 17:42:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2014-02-26 17:42:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 17:42:39 [CRITICAL] MGT underflow detected on beam(s) 1
2014-02-26 17:42:39 [DEBUG   ] Finished updating board flags in 2.117 seconds
2014-02-26 17:42:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 17:43:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 17:43:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 17:43:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 17:43:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 17:43:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 17:43:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 17:43:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 17:43:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 17:43:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 17:43:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 17:43:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 17:43:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2014-02-26 17:43:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 17:43:38 [CRITICAL] MGT underflow detected on beam(s) 1
2014-02-26 17:43:38 [DEBUG   ] Finished updating board flags in 1.450 seconds
2014-02-26 17:43:39 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-02-26 17:43:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 17:44:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 17:44:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 17:44:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 17:44:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 17:44:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 17:44:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 17:44:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 17:44:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 17:44:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 17:44:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 17:44:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 17:44:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 17:44:39 [DEBUG   ] Finished updating ant stats in 0.643 seconds
2014-02-26 17:44:39 [DEBUG   ] Finished updating board flags in 2.263 seconds
2014-02-26 17:44:59 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2014-02-26 17:45:20 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-02-26 17:45:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 17:45:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 17:45:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 17:45:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 17:45:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 17:45:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 17:45:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 17:45:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 17:45:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 17:45:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 17:45:39 [DEBUG   ] Finished updating board flags in 2.156 seconds
2014-02-26 17:45:40 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-26 17:46:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 17:46:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2014-02-26 17:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2014-02-26 17:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2014-02-26 17:46:39 [DEBUG   ] Finished updating board flags in 2.027 seconds
2014-02-26 17:46:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 17:47:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 17:47:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 17:47:35 [DEBUG   ] Got command RPT from MCS: ref #286569
2014-02-26 17:47:35 [DEBUG   ] summary = ERROR
2014-02-26 17:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286569  13 56714 64055517 A  ERRORERROR'
2014-02-26 17:47:35 [DEBUG   ] Got command RPT from MCS: ref #286570
2014-02-26 17:47:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 17:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286570  77 56714 64055518 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-02-26 17:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-02-26 17:47:39 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 17:47:39 [DEBUG   ] Finished updating board flags in 2.045 seconds
2014-02-26 17:47:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-26 17:48:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 17:48:20 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 17:48:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 17:48:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 17:48:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 17:48:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 17:48:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 17:48:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 17:48:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 17:48:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 17:48:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 17:48:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 17:48:39 [DEBUG   ] Finished updating board flags in 1.936 seconds
2014-02-26 17:48:40 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-02-26 17:49:00 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 17:49:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 17:49:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 17:49:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 17:49:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 17:49:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 17:49:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 17:49:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 17:49:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 17:49:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 17:49:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 17:49:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 17:49:39 [DEBUG   ] Finished updating board flags in 1.891 seconds
2014-02-26 17:49:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 17:50:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 17:50:20 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2014-02-26 17:50:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 17:50:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 17:50:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 17:50:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 17:50:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 17:50:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 17:50:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 17:50:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 17:50:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 17:50:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 17:50:39 [DEBUG   ] Finished updating board flags in 1.739 seconds
2014-02-26 17:50:40 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-26 17:51:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 17:51:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 17:51:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-26 17:51:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-26 17:51:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-26 17:51:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-26 17:51:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-26 17:51:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-26 17:51:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-26 17:51:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-26 17:51:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-26 17:51:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-26 17:51:39 [DEBUG   ] Finished updating board flags in 1.600 seconds
2014-02-26 17:51:40 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 17:52:00 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 17:52:20 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-26 17:52:35 [DEBUG   ] Got command RPT from MCS: ref #286586
2014-02-26 17:52:35 [DEBUG   ] summary = ERROR
2014-02-26 17:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286586  13 56714 64355509 A  ERRORERROR'
2014-02-26 17:52:35 [DEBUG   ] Got command RPT from MCS: ref #286587
2014-02-26 17:52:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 17:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286587  77 56714 64355510 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2014-02-26 17:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2014-02-26 17:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2014-02-26 17:52:39 [DEBUG   ] Finished updating board flags in 1.430 seconds
2014-02-26 17:52:40 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-26 17:53:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-26 17:53:21 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-02-26 17:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-02-26 17:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-02-26 17:53:39 [DEBUG   ] Finished updating board flags in 1.445 seconds
2014-02-26 17:53:41 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-26 17:54:01 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 17:54:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-02-26 17:54:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-26 17:54:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-26 17:54:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-26 17:54:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-26 17:54:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-26 17:54:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-26 17:54:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-26 17:54:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-26 17:54:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-26 17:54:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-26 17:54:39 [DEBUG   ] Finished updating board flags in 1.428 seconds
2014-02-26 17:54:41 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 17:55:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 17:55:21 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 17:55:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-26 17:55:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-26 17:55:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-26 17:55:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-26 17:55:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-26 17:55:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-26 17:55:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-26 17:55:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-26 17:55:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-26 17:55:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-26 17:55:39 [DEBUG   ] Finished updating board flags in 1.417 seconds
2014-02-26 17:55:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 17:56:01 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 17:56:21 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-26 17:56:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-26 17:56:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-26 17:56:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-26 17:56:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-26 17:56:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-26 17:56:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-26 17:56:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-26 17:56:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-26 17:56:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-26 17:56:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-26 17:56:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-02-26 17:56:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 17:56:39 [DEBUG   ] Finished updating board flags in 1.433 seconds
2014-02-26 17:56:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 17:57:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-26 17:57:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 17:57:35 [DEBUG   ] Got command RPT from MCS: ref #286603
2014-02-26 17:57:35 [DEBUG   ] summary = ERROR
2014-02-26 17:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286603  13 56714 64655518 A  ERRORERROR'
2014-02-26 17:57:35 [DEBUG   ] Got command RPT from MCS: ref #286604
2014-02-26 17:57:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 17:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286604  77 56714 64655518 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 17:57:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-26 17:57:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-26 17:57:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-26 17:57:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-26 17:57:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-26 17:57:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-26 17:57:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-26 17:57:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-26 17:57:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-26 17:57:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-26 17:57:40 [DEBUG   ] Finished updating board flags in 2.254 seconds
2014-02-26 17:57:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 17:58:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 17:58:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 17:58:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-26 17:58:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-26 17:58:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-26 17:58:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-26 17:58:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-26 17:58:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-26 17:58:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-26 17:58:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-26 17:58:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-26 17:58:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-26 17:58:40 [DEBUG   ] Finished updating board flags in 2.230 seconds
2014-02-26 17:58:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 17:59:01 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 17:59:21 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2014-02-26 17:59:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-26 17:59:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-26 17:59:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-26 17:59:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-26 17:59:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-26 17:59:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-26 17:59:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-26 17:59:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-26 17:59:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-26 17:59:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-26 17:59:40 [DEBUG   ] Finished updating board flags in 2.136 seconds
2014-02-26 17:59:42 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-26 18:00:02 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-26 18:00:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 18:00:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-26 18:00:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-26 18:00:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-26 18:00:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-26 18:00:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-26 18:00:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-26 18:00:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-26 18:00:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-26 18:00:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-26 18:00:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-26 18:00:40 [DEBUG   ] Finished updating board flags in 1.983 seconds
2014-02-26 18:00:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 18:01:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 18:01:22 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2014-02-26 18:01:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-26 18:01:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-26 18:01:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-26 18:01:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-26 18:01:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-26 18:01:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-26 18:01:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-26 18:01:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-26 18:01:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-26 18:01:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-26 18:01:40 [DEBUG   ] Finished updating board flags in 1.818 seconds
2014-02-26 18:01:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 18:02:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 18:02:22 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 18:02:35 [DEBUG   ] Got command RPT from MCS: ref #286620
2014-02-26 18:02:35 [DEBUG   ] summary = ERROR
2014-02-26 18:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286620  13 56714 64955521 A  ERRORERROR'
2014-02-26 18:02:35 [DEBUG   ] Got command RPT from MCS: ref #286621
2014-02-26 18:02:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 18:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286621  77 56714 64955522 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 18:02:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-26 18:02:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-26 18:02:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-26 18:02:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-26 18:02:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-26 18:02:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-26 18:02:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-26 18:02:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-26 18:02:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-26 18:02:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-26 18:02:40 [DEBUG   ] Finished updating board flags in 1.790 seconds
2014-02-26 18:02:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 18:03:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 18:03:22 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-26 18:03:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-26 18:03:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-26 18:03:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-26 18:03:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-26 18:03:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-26 18:03:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-26 18:03:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-26 18:03:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-26 18:03:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-26 18:03:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-26 18:03:40 [DEBUG   ] Finished updating board flags in 1.613 seconds
2014-02-26 18:03:42 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 18:04:02 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-26 18:04:22 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-26 18:04:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-26 18:04:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-26 18:04:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-26 18:04:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-26 18:04:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-26 18:04:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-26 18:04:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-26 18:04:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-26 18:04:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-26 18:04:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-26 18:04:40 [DEBUG   ] Finished updating board flags in 1.588 seconds
2014-02-26 18:04:43 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-02-26 18:05:03 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-26 18:05:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 18:05:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-26 18:05:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-26 18:05:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-26 18:05:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-26 18:05:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-26 18:05:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-26 18:05:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-26 18:05:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-26 18:05:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-26 18:05:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-26 18:05:40 [DEBUG   ] Finished updating board flags in 1.406 seconds
2014-02-26 18:05:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 18:06:03 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 18:06:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 18:06:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-26 18:06:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-26 18:06:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-26 18:06:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-26 18:06:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-26 18:06:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-26 18:06:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-26 18:06:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-26 18:06:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-26 18:06:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-26 18:06:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-26 18:06:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-02-26 18:06:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 18:06:40 [DEBUG   ] Finished updating board flags in 1.410 seconds
2014-02-26 18:06:43 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 18:07:03 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 18:07:23 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 18:07:35 [DEBUG   ] Got command RPT from MCS: ref #286637
2014-02-26 18:07:35 [DEBUG   ] summary = ERROR
2014-02-26 18:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286637  13 56714 65255521 A  ERRORERROR'
2014-02-26 18:07:35 [DEBUG   ] Got command RPT from MCS: ref #286638
2014-02-26 18:07:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 18:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286638  77 56714 65255522 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 18:07:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-26 18:07:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-26 18:07:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-26 18:07:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-26 18:07:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-26 18:07:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-26 18:07:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-26 18:07:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-26 18:07:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-26 18:07:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-26 18:07:40 [DEBUG   ] Finished updating board flags in 1.431 seconds
2014-02-26 18:07:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 18:08:03 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-26 18:08:23 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 18:08:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-26 18:08:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-26 18:08:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-26 18:08:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-26 18:08:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-26 18:08:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-26 18:08:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-26 18:08:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-26 18:08:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-26 18:08:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-26 18:08:41 [DEBUG   ] Finished updating board flags in 2.225 seconds
2014-02-26 18:08:43 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-26 18:09:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-26 18:09:23 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-02-26 18:09:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-26 18:09:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-26 18:09:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-26 18:09:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-26 18:09:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-26 18:09:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-26 18:09:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-26 18:09:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-26 18:09:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-26 18:09:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-26 18:09:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 18:09:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2014-02-26 18:09:41 [DEBUG   ] Finished updating board flags in 2.165 seconds
2014-02-26 18:09:44 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-02-26 18:10:00 [DEBUG   ] Got command INI from MCS: ref #286654
2014-02-26 18:10:00 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2014-02-26 18:10:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   286654   8 56714 65400298 ABOOTING'
2014-02-26 18:10:04 [DEBUG   ] Finished updating ant stats in 1.247 seconds
2014-02-26 18:10:24 [INFO    ] -------------------
2014-02-26 18:10:24 [INFO    ]  LWA board status
2014-02-26 18:10:24 [INFO    ] -------------------
2014-02-26 18:10:24 [INFO    ] DP 1: 2 lwa27
2014-02-26 18:10:24 [INFO    ] DP 1: 3 lwa24
2014-02-26 18:10:24 [INFO    ] DP 1: 4 lwa23
2014-02-26 18:10:24 [INFO    ] DP 1: 5 lwa18
2014-02-26 18:10:24 [INFO    ] DP 1: 6 lwa10
2014-02-26 18:10:24 [INFO    ] DP 1: 7 lwa32
2014-02-26 18:10:24 [INFO    ] DP 1: 8 lwa11
2014-02-26 18:10:24 [INFO    ] DP 1: 9 lwa30
2014-02-26 18:10:24 [INFO    ] DP 1: 10 lwa12
2014-02-26 18:10:24 [INFO    ] DP 1: 11 lwa8
2014-02-26 18:10:24 [INFO    ] DP 1: 12 lwa13
2014-02-26 18:10:24 [INFO    ] DP 1: 13 lwa26
2014-02-26 18:10:24 [INFO    ] DP 1: 14 lwa14
2014-02-26 18:10:24 [INFO    ] DP 1: 16 lwa22
2014-02-26 18:10:24 [INFO    ] DP 1: 17 lwa20
2014-02-26 18:10:24 [INFO    ] DP 1: 18 lwa1
2014-02-26 18:10:24 [INFO    ] DP 1: 19 lwa5
2014-02-26 18:10:24 [INFO    ] DP 1: 20 lwa25
2014-02-26 18:10:24 [INFO    ] DP 1: 21 lwa35
2014-02-26 18:10:24 [INFO    ] DP 1: 22 lwa19
2014-02-26 18:10:24 [INFO    ] DP 1: 23 lwa21
2014-02-26 18:10:24 [INFO    ] DP 1: 24 lwa6
2014-02-26 18:10:24 [INFO    ] DP 1: 25 lwa7
2014-02-26 18:10:24 [INFO    ] DP 1: 26 lwa33
2014-02-26 18:10:24 [INFO    ] DP 1: 27 lwa15
2014-02-26 18:10:24 [INFO    ] DP 1: 28 lwa28
2014-02-26 18:10:24 [INFO    ] DP 2: 1 lwa16
2014-02-26 18:10:24 [INFO    ] DP 2: 15 lwa34
2014-02-26 18:10:24 [INFO    ] Total of 28 boards
2014-02-26 18:10:24 [INFO    ] Total of 260 stands
2014-02-26 18:10:24 [INFO    ] -------------------
2014-02-26 18:10:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2014-02-26 18:10:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2014-02-26 18:10:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2014-02-26 18:10:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2014-02-26 18:10:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2014-02-26 18:10:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2014-02-26 18:10:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2014-02-26 18:10:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2014-02-26 18:10:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2014-02-26 18:10:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2014-02-26 18:10:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2014-02-26 18:10:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2014-02-26 18:10:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2014-02-26 18:10:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2014-02-26 18:10:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2014-02-26 18:10:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2014-02-26 18:10:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2014-02-26 18:10:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2014-02-26 18:10:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2014-02-26 18:10:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2014-02-26 18:10:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2014-02-26 18:10:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2014-02-26 18:10:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2014-02-26 18:10:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2014-02-26 18:10:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2014-02-26 18:10:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2014-02-26 18:10:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2014-02-26 18:10:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2014-02-26 18:10:31 [DEBUG   ] 2014-02-26 18:10:31 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23308
2014-02-26 18:10:31 [DEBUG   ] 2014-02-26 18:10:31 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23309
2014-02-26 18:10:31 [DEBUG   ] 2014-02-26 18:10:31 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23310
2014-02-26 18:10:31 [DEBUG   ] 2014-02-26 18:10:31 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23311
2014-02-26 18:10:31 [DEBUG   ] 2014-02-26 18:10:31 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23312
2014-02-26 18:10:31 [DEBUG   ] 2014-02-26 18:10:31 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23313
2014-02-26 18:10:31 [DEBUG   ] 2014-02-26 18:10:31 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23314
2014-02-26 18:10:31 [DEBUG   ] 2014-02-26 18:10:31 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23315
2014-02-26 18:10:31 [DEBUG   ] 2014-02-26 18:10:31 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23316
2014-02-26 18:10:31 [DEBUG   ] 2014-02-26 18:10:31 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23317
2014-02-26 18:10:31 [DEBUG   ] 2014-02-26 18:10:31 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23318
2014-02-26 18:10:31 [DEBUG   ] 2014-02-26 18:10:31 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23319
2014-02-26 18:10:31 [DEBUG   ] 2014-02-26 18:10:31 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23320
2014-02-26 18:10:31 [DEBUG   ] 2014-02-26 18:10:31 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23321
2014-02-26 18:10:31 [DEBUG   ] 2014-02-26 18:10:31 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23322
2014-02-26 18:10:31 [DEBUG   ] 2014-02-26 18:10:31 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23323
2014-02-26 18:10:31 [DEBUG   ] 2014-02-26 18:10:31 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23324
2014-02-26 18:10:31 [DEBUG   ] 2014-02-26 18:10:31 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23325
2014-02-26 18:10:31 [DEBUG   ] 2014-02-26 18:10:31 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23326
2014-02-26 18:10:31 [DEBUG   ] 2014-02-26 18:10:31 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23327
2014-02-26 18:10:31 [DEBUG   ] 2014-02-26 18:10:31 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23328
2014-02-26 18:10:31 [DEBUG   ] 2014-02-26 18:10:31 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23329
2014-02-26 18:10:31 [DEBUG   ] 2014-02-26 18:10:31 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23330
2014-02-26 18:10:31 [DEBUG   ] 2014-02-26 18:10:31 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23331
2014-02-26 18:10:31 [DEBUG   ] 2014-02-26 18:10:31 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23332
2014-02-26 18:10:31 [DEBUG   ] 2014-02-26 18:10:31 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23333
2014-02-26 18:10:43 [DEBUG   ] 2014-02-26 18:10:43 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23308 exited with status 0
2014-02-26 18:10:43 [DEBUG   ] 2014-02-26 18:10:43 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23309 exited with status 0
2014-02-26 18:10:43 [DEBUG   ] 2014-02-26 18:10:43 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23310 exited with status 0
2014-02-26 18:10:43 [DEBUG   ] 2014-02-26 18:10:43 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23311 exited with status 0
2014-02-26 18:10:43 [DEBUG   ] 2014-02-26 18:10:43 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23312 exited with status 0
2014-02-26 18:10:43 [DEBUG   ] 2014-02-26 18:10:43 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23313 exited with status 0
2014-02-26 18:10:43 [DEBUG   ] 2014-02-26 18:10:43 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23314 exited with status 0
2014-02-26 18:10:43 [DEBUG   ] 2014-02-26 18:10:43 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23315 exited with status 0
2014-02-26 18:10:44 [DEBUG   ] 2014-02-26 18:10:44 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23316 exited with status 0
2014-02-26 18:10:44 [DEBUG   ] 2014-02-26 18:10:44 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23317 exited with status 0
2014-02-26 18:10:44 [DEBUG   ] 2014-02-26 18:10:44 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23318 exited with status 0
2014-02-26 18:10:44 [DEBUG   ] 2014-02-26 18:10:44 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23319 exited with status 0
2014-02-26 18:10:44 [DEBUG   ] 2014-02-26 18:10:44 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23320 exited with status 0
2014-02-26 18:10:44 [DEBUG   ] 2014-02-26 18:10:44 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23321 exited with status 0
2014-02-26 18:10:44 [DEBUG   ] 2014-02-26 18:10:44 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23322 exited with status 0
2014-02-26 18:10:44 [DEBUG   ] 2014-02-26 18:10:44 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23323 exited with status 0
2014-02-26 18:10:44 [DEBUG   ] 2014-02-26 18:10:44 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23324 exited with status 0
2014-02-26 18:10:44 [DEBUG   ] 2014-02-26 18:10:44 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23325 exited with status 0
2014-02-26 18:10:44 [DEBUG   ] 2014-02-26 18:10:44 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23326 exited with status 0
2014-02-26 18:10:44 [DEBUG   ] 2014-02-26 18:10:44 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23327 exited with status 0
2014-02-26 18:10:44 [DEBUG   ] 2014-02-26 18:10:44 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23328 exited with status 0
2014-02-26 18:10:44 [DEBUG   ] 2014-02-26 18:10:44 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23329 exited with status 0
2014-02-26 18:10:44 [DEBUG   ] 2014-02-26 18:10:44 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23330 exited with status 0
2014-02-26 18:10:44 [DEBUG   ] 2014-02-26 18:10:44 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23331 exited with status 0
2014-02-26 18:10:44 [DEBUG   ] 2014-02-26 18:10:44 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23332 exited with status 0
2014-02-26 18:10:44 [DEBUG   ] 2014-02-26 18:10:44 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23333 exited with status 0
2014-02-26 18:10:44 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2014-02-26 18:10:44 [DEBUG   ] spawn_process: at 2014-02-26 18:10:44 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2014-02-26 18:10:44 [DEBUG   ] spawn_process: at 2014-02-26 18:10:44 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2014-02-26 18:10:44 [DEBUG   ] spawn_process: at 2014-02-26 18:10:44 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2014-02-26 18:10:44 [DEBUG   ] spawn_process: at 2014-02-26 18:10:44 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2014-02-26 18:10:44 [DEBUG   ] spawn_process: at 2014-02-26 18:10:44 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2014-02-26 18:10:44 [DEBUG   ] spawn_process: at 2014-02-26 18:10:44 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2014-02-26 18:10:44 [DEBUG   ] spawn_process: at 2014-02-26 18:10:44 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2014-02-26 18:10:44 [DEBUG   ] spawn_process: at 2014-02-26 18:10:44 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2014-02-26 18:10:44 [DEBUG   ] spawn_process: at 2014-02-26 18:10:44 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2014-02-26 18:10:44 [DEBUG   ] spawn_process: at 2014-02-26 18:10:44 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2014-02-26 18:10:44 [DEBUG   ] spawn_process: at 2014-02-26 18:10:44 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2014-02-26 18:10:44 [DEBUG   ] spawn_process: at 2014-02-26 18:10:44 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2014-02-26 18:10:44 [DEBUG   ] spawn_process: at 2014-02-26 18:10:44 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2014-02-26 18:10:44 [DEBUG   ] spawn_process: at 2014-02-26 18:10:44 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2014-02-26 18:10:44 [DEBUG   ] spawn_process: at 2014-02-26 18:10:44 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2014-02-26 18:10:44 [DEBUG   ] spawn_process: at 2014-02-26 18:10:44 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2014-02-26 18:10:44 [DEBUG   ] spawn_process: at 2014-02-26 18:10:44 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2014-02-26 18:10:44 [DEBUG   ] spawn_process: at 2014-02-26 18:10:44 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2014-02-26 18:10:44 [DEBUG   ] spawn_process: at 2014-02-26 18:10:44 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2014-02-26 18:10:44 [DEBUG   ] spawn_process: at 2014-02-26 18:10:44 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2014-02-26 18:10:44 [DEBUG   ] spawn_process: at 2014-02-26 18:10:44 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2014-02-26 18:10:44 [DEBUG   ] spawn_process: at 2014-02-26 18:10:44 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2014-02-26 18:10:44 [DEBUG   ] spawn_process: at 2014-02-26 18:10:44 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2014-02-26 18:10:44 [DEBUG   ] spawn_process: at 2014-02-26 18:10:44 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2014-02-26 18:10:44 [DEBUG   ] spawn_process: at 2014-02-26 18:10:44 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2014-02-26 18:10:44 [DEBUG   ] spawn_process: at 2014-02-26 18:10:44 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2014-02-26 18:10:44 [DEBUG   ] 2014-02-26 18:10:44 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 23360
2014-02-26 18:10:44 [DEBUG   ] 2014-02-26 18:10:44 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 23361
2014-02-26 18:10:49 [DEBUG   ] 2014-02-26 18:10:49 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 23360 exited with status 0
2014-02-26 18:10:49 [DEBUG   ] 2014-02-26 18:10:49 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 23361 exited with status 0
2014-02-26 18:10:49 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2014-02-26 18:10:49 [DEBUG   ] spawn_process: at 2014-02-26 18:10:49 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2014-02-26 18:10:49 [DEBUG   ] spawn_process: at 2014-02-26 18:10:49 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2014-02-26 18:10:49 [INFO    ] Setting Beam 1 xbars
2014-02-26 18:10:49 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2014-02-26 18:10:50 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2014-02-26 18:10:50 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2014-02-26 18:10:50 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2014-02-26 18:10:50 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2014-02-26 18:10:50 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2014-02-26 18:10:50 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2014-02-26 18:10:50 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2014-02-26 18:10:50 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2014-02-26 18:10:50 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2014-02-26 18:10:51 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2014-02-26 18:10:51 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2014-02-26 18:10:51 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2014-02-26 18:10:51 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2014-02-26 18:10:51 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2014-02-26 18:10:51 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2014-02-26 18:10:51 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2014-02-26 18:10:51 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2014-02-26 18:10:51 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2014-02-26 18:10:52 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2014-02-26 18:10:52 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2014-02-26 18:10:52 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2014-02-26 18:10:52 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2014-02-26 18:10:52 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2014-02-26 18:10:52 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2014-02-26 18:10:52 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2014-02-26 18:10:52 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2014-02-26 18:10:52 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2014-02-26 18:10:53 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2014-02-26 18:10:53 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2014-02-26 18:10:53 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2014-02-26 18:10:53 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2014-02-26 18:10:53 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2014-02-26 18:10:53 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2014-02-26 18:10:53 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2014-02-26 18:10:53 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2014-02-26 18:10:53 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2014-02-26 18:10:53 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2014-02-26 18:10:54 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2014-02-26 18:10:54 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2014-02-26 18:10:54 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2014-02-26 18:10:54 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2014-02-26 18:10:54 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2014-02-26 18:10:54 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2014-02-26 18:10:54 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2014-02-26 18:10:54 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2014-02-26 18:10:54 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2014-02-26 18:10:55 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2014-02-26 18:10:55 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2014-02-26 18:10:55 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2014-02-26 18:10:55 [INFO    ] Setting Beam 2 xbars
2014-02-26 18:10:55 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2014-02-26 18:10:55 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2014-02-26 18:10:55 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2014-02-26 18:10:55 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2014-02-26 18:10:55 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2014-02-26 18:10:55 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2014-02-26 18:10:56 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2014-02-26 18:10:56 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2014-02-26 18:10:56 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2014-02-26 18:10:56 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2014-02-26 18:10:56 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2014-02-26 18:10:56 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2014-02-26 18:10:56 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2014-02-26 18:10:56 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2014-02-26 18:10:56 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2014-02-26 18:10:56 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2014-02-26 18:10:57 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2014-02-26 18:10:57 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2014-02-26 18:10:57 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2014-02-26 18:10:57 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2014-02-26 18:10:57 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2014-02-26 18:10:57 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2014-02-26 18:10:57 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2014-02-26 18:10:57 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2014-02-26 18:10:57 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2014-02-26 18:10:58 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2014-02-26 18:10:58 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2014-02-26 18:10:58 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2014-02-26 18:10:58 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2014-02-26 18:10:58 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2014-02-26 18:10:58 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2014-02-26 18:10:58 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2014-02-26 18:10:58 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2014-02-26 18:10:58 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2014-02-26 18:10:59 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2014-02-26 18:10:59 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2014-02-26 18:10:59 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2014-02-26 18:10:59 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2014-02-26 18:10:59 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2014-02-26 18:10:59 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2014-02-26 18:10:59 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2014-02-26 18:10:59 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2014-02-26 18:10:59 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2014-02-26 18:11:00 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2014-02-26 18:11:00 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2014-02-26 18:11:00 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2014-02-26 18:11:00 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2014-02-26 18:11:00 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2014-02-26 18:11:00 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2014-02-26 18:11:00 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2014-02-26 18:11:00 [INFO    ] Setting Beam 3 xbars
2014-02-26 18:11:00 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2014-02-26 18:11:00 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2014-02-26 18:11:00 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2014-02-26 18:11:01 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2014-02-26 18:11:01 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2014-02-26 18:11:01 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2014-02-26 18:11:01 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2014-02-26 18:11:01 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2014-02-26 18:11:01 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2014-02-26 18:11:01 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2014-02-26 18:11:01 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2014-02-26 18:11:01 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2014-02-26 18:11:02 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2014-02-26 18:11:02 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2014-02-26 18:11:02 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2014-02-26 18:11:02 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2014-02-26 18:11:02 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2014-02-26 18:11:02 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2014-02-26 18:11:02 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2014-02-26 18:11:02 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2014-02-26 18:11:02 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2014-02-26 18:11:03 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2014-02-26 18:11:03 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2014-02-26 18:11:03 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2014-02-26 18:11:03 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2014-02-26 18:11:03 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2014-02-26 18:11:03 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2014-02-26 18:11:03 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2014-02-26 18:11:03 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2014-02-26 18:11:03 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2014-02-26 18:11:03 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2014-02-26 18:11:04 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2014-02-26 18:11:04 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2014-02-26 18:11:04 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2014-02-26 18:11:04 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2014-02-26 18:11:04 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2014-02-26 18:11:04 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2014-02-26 18:11:04 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2014-02-26 18:11:04 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2014-02-26 18:11:04 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2014-02-26 18:11:05 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2014-02-26 18:11:05 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2014-02-26 18:11:05 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2014-02-26 18:11:05 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2014-02-26 18:11:05 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2014-02-26 18:11:05 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2014-02-26 18:11:05 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2014-02-26 18:11:05 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2014-02-26 18:11:05 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2014-02-26 18:11:06 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2014-02-26 18:11:06 [INFO    ] Setting Beam 4 xbars
2014-02-26 18:11:06 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2014-02-26 18:11:06 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2014-02-26 18:11:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2014-02-26 18:11:06 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2014-02-26 18:11:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2014-02-26 18:11:06 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2014-02-26 18:11:06 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2014-02-26 18:11:06 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2014-02-26 18:11:07 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2014-02-26 18:11:07 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2014-02-26 18:11:07 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2014-02-26 18:11:07 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2014-02-26 18:11:07 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2014-02-26 18:11:07 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2014-02-26 18:11:07 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2014-02-26 18:11:07 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2014-02-26 18:11:07 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2014-02-26 18:11:08 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2014-02-26 18:11:08 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2014-02-26 18:11:08 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2014-02-26 18:11:08 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2014-02-26 18:11:08 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2014-02-26 18:11:08 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2014-02-26 18:11:08 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2014-02-26 18:11:08 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2014-02-26 18:11:08 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2014-02-26 18:11:08 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2014-02-26 18:11:09 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2014-02-26 18:11:09 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2014-02-26 18:11:09 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2014-02-26 18:11:09 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2014-02-26 18:11:09 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2014-02-26 18:11:09 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2014-02-26 18:11:09 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2014-02-26 18:11:09 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2014-02-26 18:11:09 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2014-02-26 18:11:10 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2014-02-26 18:11:10 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2014-02-26 18:11:10 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2014-02-26 18:11:10 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2014-02-26 18:11:10 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2014-02-26 18:11:10 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2014-02-26 18:11:10 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2014-02-26 18:11:10 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2014-02-26 18:11:10 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2014-02-26 18:11:11 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2014-02-26 18:11:11 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2014-02-26 18:11:11 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2014-02-26 18:11:11 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2014-02-26 18:11:11 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2014-02-26 18:11:11 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2014-02-26 18:11:11 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2014-02-26 18:11:11 [INFO    ] All xbars set
2014-02-26 18:11:11 [INFO    ] Setting adder chain routing for all beams
2014-02-26 18:11:16 [INFO    ] Setting beam ids
2014-02-26 18:11:26 [INFO    ] Starting beam delay calibration
2014-02-26 18:11:38 [INFO    ] Beam 1 latency is 5731
2014-02-26 18:11:38 [INFO    ] Beam 2 latency is 5739
2014-02-26 18:11:38 [INFO    ] Beam 3 latency is 5735
2014-02-26 18:11:38 [INFO    ] Beam 4 latency is 5723
2014-02-26 18:11:38 [INFO    ] Stop calibration
2014-02-26 18:11:46 [INFO    ] Beam delay calibration successful
2014-02-26 18:11:46 [INFO    ] Calibration passed
2014-02-26 18:11:46 [DEBUG   ] spawn_process: at 2014-02-26 18:11:46 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2014-02-26 18:11:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2014-02-26 18:11:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2014-02-26 18:11:46 [DEBUG   ] spawn_process: at 2014-02-26 18:11:46 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2014-02-26 18:11:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2014-02-26 18:11:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2014-02-26 18:11:46 [DEBUG   ] spawn_process: at 2014-02-26 18:11:46 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2014-02-26 18:11:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2014-02-26 18:11:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2014-02-26 18:11:46 [DEBUG   ] spawn_process: at 2014-02-26 18:11:46 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2014-02-26 18:11:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2014-02-26 18:11:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2014-02-26 18:11:46 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2014-02-26 18:11:47 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 262 ms (1393438307.265 s) with PID 24931 and time 1393438308
2014-02-26 18:11:47 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2014-02-26 18:11:47 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 351 ms (1393438307.354 s) with PID 24934 and time 1393438308
2014-02-26 18:11:48 [DEBUG   ] Finished updating ant stats in 0.894 seconds
2014-02-26 18:11:48 [INFO    ] Started antennas statistics background thread
2014-02-26 18:11:48 [INFO    ] Started board flags background thread
2014-02-26 18:11:48 [INFO    ] Started BAM background thread
2014-02-26 18:11:48 [INFO    ] Finished the INI process (ref. #286654) in 108.180 s
2014-02-26 18:11:49 [DEBUG   ] Finished updating board flags in 1.075 seconds
2014-02-26 18:12:08 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-02-26 18:12:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 18:12:35 [DEBUG   ] Got command RPT from MCS: ref #286655
2014-02-26 18:12:35 [DEBUG   ] summary = NORMAL
2014-02-26 18:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286655  14 56714 65555518 A NORMALNORMAL'
2014-02-26 18:12:35 [DEBUG   ] Got command RPT from MCS: ref #286656
2014-02-26 18:12:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 18:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286656  48 56714 65555518 A NORMALSystem calibrated and operating normally'
2014-02-26 18:12:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 18:12:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-26 18:12:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 18:12:49 [DEBUG   ] Finished updating board flags in 1.009 seconds
2014-02-26 18:13:08 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-02-26 18:13:28 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-26 18:13:48 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-26 18:13:49 [DEBUG   ] Finished updating board flags in 1.005 seconds
2014-02-26 18:14:08 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-26 18:14:28 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-26 18:14:48 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-26 18:14:49 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 18:14:49 [DEBUG   ] Finished updating board flags in 1.054 seconds
2014-02-26 18:15:00 [DEBUG   ] Got command RPT from MCS: ref #286672
2014-02-26 18:15:00 [DEBUG   ] summary = NORMAL
2014-02-26 18:15:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286672  14 56714 65700301 A NORMALNORMAL'
2014-02-26 18:15:08 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-26 18:15:28 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-26 18:15:48 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-26 18:15:50 [DEBUG   ] Finished updating board flags in 2.019 seconds
2014-02-26 18:16:08 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2014-02-26 18:16:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 18:16:49 [DEBUG   ] Finished updating ant stats in 1.239 seconds
2014-02-26 18:16:50 [DEBUG   ] Finished updating board flags in 1.917 seconds
2014-02-26 18:17:09 [DEBUG   ] Finished updating ant stats in 1.167 seconds
2014-02-26 18:17:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 18:17:35 [DEBUG   ] Got command RPT from MCS: ref #286673
2014-02-26 18:17:35 [DEBUG   ] summary = NORMAL
2014-02-26 18:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286673  14 56714 65855525 A NORMALNORMAL'
2014-02-26 18:17:35 [DEBUG   ] Got command RPT from MCS: ref #286674
2014-02-26 18:17:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 18:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286674  48 56714 65855526 A NORMALSystem calibrated and operating normally'
2014-02-26 18:17:49 [DEBUG   ] Finished updating ant stats in 1.038 seconds
2014-02-26 18:17:50 [DEBUG   ] Finished updating board flags in 1.816 seconds
2014-02-26 18:18:09 [DEBUG   ] Finished updating ant stats in 0.967 seconds
2014-02-26 18:18:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 18:18:49 [DEBUG   ] Finished updating ant stats in 0.837 seconds
2014-02-26 18:18:50 [DEBUG   ] Finished updating board flags in 1.783 seconds
2014-02-26 18:19:09 [DEBUG   ] Finished updating ant stats in 0.767 seconds
2014-02-26 18:19:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 18:19:49 [DEBUG   ] Finished updating ant stats in 0.632 seconds
2014-02-26 18:19:50 [DEBUG   ] Finished updating board flags in 1.621 seconds
2014-02-26 18:20:09 [DEBUG   ] Finished updating ant stats in 0.571 seconds
2014-02-26 18:20:29 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2014-02-26 18:20:50 [DEBUG   ] Finished updating ant stats in 1.230 seconds
2014-02-26 18:20:50 [DEBUG   ] Finished updating board flags in 1.640 seconds
2014-02-26 18:21:10 [DEBUG   ] Finished updating ant stats in 1.175 seconds
2014-02-26 18:21:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 18:21:49 [DEBUG   ] Finished updating board flags in 1.034 seconds
2014-02-26 18:21:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 18:22:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 18:22:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 18:22:35 [DEBUG   ] Got command RPT from MCS: ref #286690
2014-02-26 18:22:35 [DEBUG   ] summary = NORMAL
2014-02-26 18:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286690  14 56714 66155521 A NORMALNORMAL'
2014-02-26 18:22:35 [DEBUG   ] Got command RPT from MCS: ref #286691
2014-02-26 18:22:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 18:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286691  48 56714 66155522 A NORMALSystem calibrated and operating normally'
2014-02-26 18:22:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 18:22:50 [DEBUG   ] Finished updating ant stats in 1.030 seconds
2014-02-26 18:22:50 [DEBUG   ] Finished updating board flags in 1.601 seconds
2014-02-26 18:23:10 [DEBUG   ] Finished updating ant stats in 0.975 seconds
2014-02-26 18:23:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-26 18:23:49 [DEBUG   ] Finished updating board flags in 1.014 seconds
2014-02-26 18:23:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 18:24:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 18:24:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-26 18:24:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 18:24:50 [DEBUG   ] Finished updating ant stats in 0.826 seconds
2014-02-26 18:24:50 [DEBUG   ] Finished updating board flags in 1.584 seconds
2014-02-26 18:25:10 [DEBUG   ] Finished updating ant stats in 0.775 seconds
2014-02-26 18:25:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 18:25:50 [DEBUG   ] Finished updating ant stats in 0.629 seconds
2014-02-26 18:25:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 18:25:50 [DEBUG   ] Finished updating board flags in 1.376 seconds
2014-02-26 18:26:05 [DEBUG   ] Got command DRX from MCS: ref #286711
2014-02-26 18:26:05 [INFO    ] sending drx command to lwa34
2014-02-26 18:26:05 [DEBUG   ] run_process: at 2014-02-26 18:26:05 running ['/usr/local/bin/lwa34', '/lwa/software/drx 5 1 58000000.0 7 13 57']
2014-02-26 18:26:05 [DEBUG   ] drx = exited with status True, code 0x00
2014-02-26 18:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   286711   8 56714 66365006 A NORMAL'
2014-02-26 18:26:05 [DEBUG   ] Got command DRX from MCS: ref #286712
2014-02-26 18:26:05 [INFO    ] sending drx command to lwa34
2014-02-26 18:26:05 [DEBUG   ] run_process: at 2014-02-26 18:26:05 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 58000000.0 7 13 57']
2014-02-26 18:26:05 [DEBUG   ] drx = exited with status True, code 0x00
2014-02-26 18:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   286712   8 56714 66365010 A NORMAL'
2014-02-26 18:26:05 [DEBUG   ] Got command DRX from MCS: ref #286713
2014-02-26 18:26:05 [INFO    ] sending drx command to lwa16
2014-02-26 18:26:05 [DEBUG   ] run_process: at 2014-02-26 18:26:05 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 58000000.0 7 13 57']
2014-02-26 18:26:05 [DEBUG   ] drx = exited with status True, code 0x00
2014-02-26 18:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   286713   8 56714 66365014 A NORMAL'
2014-02-26 18:26:05 [DEBUG   ] Got command DRX from MCS: ref #286714
2014-02-26 18:26:05 [INFO    ] sending drx command to lwa16
2014-02-26 18:26:05 [DEBUG   ] run_process: at 2014-02-26 18:26:05 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 1 58000000.0 7 13 57']
2014-02-26 18:26:05 [DEBUG   ] drx = exited with status True, code 0x00
2014-02-26 18:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   286714   8 56714 66365018 A NORMAL'
2014-02-26 18:26:05 [INFO    ] Finished starting DRX
2014-02-26 18:26:05 [INFO    ] Finished starting DRX
2014-02-26 18:26:05 [INFO    ] Finished starting DRX
2014-02-26 18:26:05 [INFO    ] Finished starting DRX
2014-02-26 18:26:05 [DEBUG   ] Got command DRX from MCS: ref #286715
2014-02-26 18:26:05 [INFO    ] sending drx command to lwa34
2014-02-26 18:26:05 [DEBUG   ] run_process: at 2014-02-26 18:26:05 running ['/usr/local/bin/lwa34', '/lwa/software/drx 5 2 74000000.0 7 13 57']
2014-02-26 18:26:05 [DEBUG   ] drx = exited with status True, code 0x00
2014-02-26 18:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   286715   8 56714 66365214 A NORMAL'
2014-02-26 18:26:05 [INFO    ] Finished starting DRX
2014-02-26 18:26:05 [DEBUG   ] Got command DRX from MCS: ref #286716
2014-02-26 18:26:05 [INFO    ] sending drx command to lwa34
2014-02-26 18:26:05 [DEBUG   ] run_process: at 2014-02-26 18:26:05 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 74000000.0 7 13 57']
2014-02-26 18:26:05 [DEBUG   ] drx = exited with status True, code 0x00
2014-02-26 18:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   286716   8 56714 66365314 A NORMAL'
2014-02-26 18:26:05 [INFO    ] Finished starting DRX
2014-02-26 18:26:05 [DEBUG   ] Got command DRX from MCS: ref #286717
2014-02-26 18:26:05 [INFO    ] sending drx command to lwa16
2014-02-26 18:26:05 [DEBUG   ] run_process: at 2014-02-26 18:26:05 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 74000000.0 7 13 57']
2014-02-26 18:26:05 [DEBUG   ] drx = exited with status True, code 0x00
2014-02-26 18:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   286717   8 56714 66365402 A NORMAL'
2014-02-26 18:26:05 [INFO    ] Finished starting DRX
2014-02-26 18:26:05 [DEBUG   ] Got command DRX from MCS: ref #286718
2014-02-26 18:26:05 [INFO    ] sending drx command to lwa16
2014-02-26 18:26:05 [DEBUG   ] run_process: at 2014-02-26 18:26:05 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 2 74000000.0 7 13 57']
2014-02-26 18:26:05 [DEBUG   ] drx = exited with status True, code 0x00
2014-02-26 18:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   286718   8 56714 66365482 A NORMAL'
2014-02-26 18:26:05 [INFO    ] Finished starting DRX
2014-02-26 18:26:05 [DEBUG   ] Got command BAM from MCS: ref #286722
2014-02-26 18:26:05 [INFO    ] Finished processing BAM request
2014-02-26 18:26:05 [DEBUG   ] bam = exited with status True, code 0x00
2014-02-26 18:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   286722   8 56714 66365557 A NORMAL'
2014-02-26 18:26:05 [DEBUG   ] Got command BAM from MCS: ref #286719
2014-02-26 18:26:05 [INFO    ] Finished processing BAM request
2014-02-26 18:26:05 [DEBUG   ] bam = exited with status True, code 0x00
2014-02-26 18:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   286719   8 56714 66365657 A NORMAL'
2014-02-26 18:26:05 [DEBUG   ] Got command BAM from MCS: ref #286720
2014-02-26 18:26:05 [INFO    ] Finished processing BAM request
2014-02-26 18:26:05 [DEBUG   ] bam = exited with status True, code 0x00
2014-02-26 18:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   286720   8 56714 66365757 A NORMAL'
2014-02-26 18:26:05 [DEBUG   ] Got command BAM from MCS: ref #286721
2014-02-26 18:26:05 [INFO    ] Finished processing BAM request
2014-02-26 18:26:05 [DEBUG   ] bam = exited with status True, code 0x00
2014-02-26 18:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   286721   8 56714 66365845 A NORMAL'
2014-02-26 18:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2014-02-26 18:26:05 [DEBUG   ] spawn_process: at 2014-02-26 18:26:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2014-02-26 18:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2014-02-26 18:26:05 [DEBUG   ] spawn_process: at 2014-02-26 18:26:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2014-02-26 18:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2014-02-26 18:26:05 [DEBUG   ] spawn_process: at 2014-02-26 18:26:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2014-02-26 18:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2014-02-26 18:26:05 [DEBUG   ] spawn_process: at 2014-02-26 18:26:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2014-02-26 18:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2014-02-26 18:26:05 [DEBUG   ] spawn_process: at 2014-02-26 18:26:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2014-02-26 18:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2014-02-26 18:26:05 [DEBUG   ] spawn_process: at 2014-02-26 18:26:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2014-02-26 18:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2014-02-26 18:26:05 [DEBUG   ] spawn_process: at 2014-02-26 18:26:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2014-02-26 18:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2014-02-26 18:26:05 [DEBUG   ] spawn_process: at 2014-02-26 18:26:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2014-02-26 18:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2014-02-26 18:26:05 [DEBUG   ] spawn_process: at 2014-02-26 18:26:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2014-02-26 18:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2014-02-26 18:26:05 [DEBUG   ] spawn_process: at 2014-02-26 18:26:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2014-02-26 18:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2014-02-26 18:26:05 [DEBUG   ] spawn_process: at 2014-02-26 18:26:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2014-02-26 18:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2014-02-26 18:26:05 [DEBUG   ] spawn_process: at 2014-02-26 18:26:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2014-02-26 18:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2014-02-26 18:26:05 [DEBUG   ] spawn_process: at 2014-02-26 18:26:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2014-02-26 18:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2014-02-26 18:26:05 [DEBUG   ] spawn_process: at 2014-02-26 18:26:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2014-02-26 18:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2014-02-26 18:26:05 [DEBUG   ] spawn_process: at 2014-02-26 18:26:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2014-02-26 18:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2014-02-26 18:26:05 [DEBUG   ] spawn_process: at 2014-02-26 18:26:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2014-02-26 18:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2014-02-26 18:26:05 [DEBUG   ] spawn_process: at 2014-02-26 18:26:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2014-02-26 18:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2014-02-26 18:26:05 [DEBUG   ] spawn_process: at 2014-02-26 18:26:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2014-02-26 18:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2014-02-26 18:26:05 [DEBUG   ] spawn_process: at 2014-02-26 18:26:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2014-02-26 18:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2014-02-26 18:26:05 [DEBUG   ] spawn_process: at 2014-02-26 18:26:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2014-02-26 18:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2014-02-26 18:26:05 [DEBUG   ] spawn_process: at 2014-02-26 18:26:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2014-02-26 18:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2014-02-26 18:26:05 [DEBUG   ] spawn_process: at 2014-02-26 18:26:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2014-02-26 18:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2014-02-26 18:26:05 [DEBUG   ] spawn_process: at 2014-02-26 18:26:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2014-02-26 18:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2014-02-26 18:26:05 [DEBUG   ] spawn_process: at 2014-02-26 18:26:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2014-02-26 18:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2014-02-26 18:26:05 [DEBUG   ] spawn_process: at 2014-02-26 18:26:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2014-02-26 18:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2014-02-26 18:26:05 [DEBUG   ] spawn_process: at 2014-02-26 18:26:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2014-02-26 18:26:10 [DEBUG   ] Finished updating ant stats in 0.575 seconds
2014-02-26 18:26:30 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-26 18:26:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-26 18:26:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 18:26:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-26 18:26:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-02-26 18:26:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-26 18:26:50 [DEBUG   ] Finished updating ant stats in 0.430 seconds
2014-02-26 18:26:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2014-02-26 18:26:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 18:26:50 [DEBUG   ] Finished updating board flags in 1.223 seconds
2014-02-26 18:27:10 [DEBUG   ] Finished updating ant stats in 0.375 seconds
2014-02-26 18:27:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 18:27:35 [DEBUG   ] Got command RPT from MCS: ref #286727
2014-02-26 18:27:35 [DEBUG   ] summary = NORMAL
2014-02-26 18:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286727  14 56714 66455517 A NORMALNORMAL'
2014-02-26 18:27:35 [DEBUG   ] Got command RPT from MCS: ref #286728
2014-02-26 18:27:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 18:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286728  48 56714 66455518 A NORMALSystem calibrated and operating normally'
2014-02-26 18:27:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-02-26 18:27:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-26 18:27:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2014-02-26 18:27:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2014-02-26 18:27:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 18:27:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 18:27:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 18:27:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-26 18:27:51 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 18:27:51 [DEBUG   ] Finished updating board flags in 2.295 seconds
2014-02-26 18:28:11 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 18:28:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 18:28:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-26 18:28:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-02-26 18:28:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-26 18:28:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-26 18:28:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 18:28:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-26 18:28:50 [DEBUG   ] Finished updating board flags in 1.076 seconds
2014-02-26 18:28:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 18:29:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 18:29:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 18:29:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-26 18:29:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-26 18:29:51 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-26 18:29:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-26 18:29:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-26 18:29:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 18:29:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2014-02-26 18:29:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 18:29:51 [DEBUG   ] Finished updating board flags in 2.403 seconds
2014-02-26 18:30:11 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 18:30:31 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-26 18:30:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2014-02-26 18:30:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 18:30:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 4
2014-02-26 18:30:50 [DEBUG   ] Finished updating board flags in 1.446 seconds
2014-02-26 18:30:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-26 18:31:11 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-26 18:31:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 18:31:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2014-02-26 18:31:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2014-02-26 18:31:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-02-26 18:31:51 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-26 18:31:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 18:31:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 18:31:51 [DEBUG   ] Finished updating board flags in 1.957 seconds
2014-02-26 18:32:11 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-26 18:32:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-26 18:32:35 [DEBUG   ] Got command RPT from MCS: ref #286744
2014-02-26 18:32:35 [DEBUG   ] summary = NORMAL
2014-02-26 18:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286744  14 56714 66755525 A NORMALNORMAL'
2014-02-26 18:32:35 [DEBUG   ] Got command RPT from MCS: ref #286745
2014-02-26 18:32:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 18:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286745  48 56714 66755526 A NORMALSystem calibrated and operating normally'
2014-02-26 18:32:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-26 18:32:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2014-02-26 18:32:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-26 18:32:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-26 18:32:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 18:32:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 18:32:50 [DEBUG   ] Finished updating board flags in 1.216 seconds
2014-02-26 18:32:51 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-26 18:33:11 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-02-26 18:33:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-26 18:33:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-02-26 18:33:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-26 18:33:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-02-26 18:33:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-26 18:33:51 [DEBUG   ] Finished updating ant stats in 0.430 seconds
2014-02-26 18:33:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 18:33:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 18:33:51 [DEBUG   ] Finished updating board flags in 1.820 seconds
2014-02-26 18:34:11 [DEBUG   ] Finished updating ant stats in 0.375 seconds
2014-02-26 18:34:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 18:34:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-26 18:34:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2014-02-26 18:34:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 18:34:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-26 18:34:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 18:34:50 [DEBUG   ] Finished updating board flags in 1.163 seconds
2014-02-26 18:34:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 18:35:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 18:35:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 18:35:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-26 18:35:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-26 18:35:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-26 18:35:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 18:35:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 18:35:50 [DEBUG   ] Finished updating board flags in 1.036 seconds
2014-02-26 18:35:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 18:36:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 18:36:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 18:36:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 4
2014-02-26 18:36:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-26 18:36:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 18:36:50 [DEBUG   ] Finished updating board flags in 0.971 seconds
2014-02-26 18:36:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 18:37:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 18:37:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 18:37:35 [DEBUG   ] Got command RPT from MCS: ref #286761
2014-02-26 18:37:35 [DEBUG   ] summary = NORMAL
2014-02-26 18:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286761  14 56714 67055529 A NORMALNORMAL'
2014-02-26 18:37:35 [DEBUG   ] Got command RPT from MCS: ref #286762
2014-02-26 18:37:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 18:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286762  48 56714 67055530 A NORMALSystem calibrated and operating normally'
2014-02-26 18:37:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-26 18:37:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-26 18:37:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-26 18:37:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-26 18:37:52 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-26 18:37:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-02-26 18:37:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-26 18:37:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-02-26 18:37:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 18:37:52 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 18:37:52 [DEBUG   ] Finished updating board flags in 2.533 seconds
2014-02-26 18:38:12 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 18:38:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 18:38:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-26 18:38:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 2
2014-02-26 18:38:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-02-26 18:38:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 18:38:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2014-02-26 18:38:51 [DEBUG   ] Finished updating board flags in 1.255 seconds
2014-02-26 18:38:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 18:39:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 18:39:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 18:39:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2014-02-26 18:39:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-26 18:39:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 18:39:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2014-02-26 18:39:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-02-26 18:39:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 18:39:52 [DEBUG   ] Finished updating board flags in 2.154 seconds
2014-02-26 18:40:12 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-26 18:40:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 18:40:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-26 18:40:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 18:40:51 [DEBUG   ] Finished updating board flags in 1.113 seconds
2014-02-26 18:40:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 18:41:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 18:41:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 18:41:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-26 18:41:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 18:41:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-26 18:41:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 18:41:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-26 18:41:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 18:41:52 [DEBUG   ] Finished updating board flags in 2.185 seconds
2014-02-26 18:42:12 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2014-02-26 18:42:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 18:42:35 [DEBUG   ] Got command RPT from MCS: ref #286778
2014-02-26 18:42:35 [DEBUG   ] summary = NORMAL
2014-02-26 18:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286778  14 56714 67355521 A NORMALNORMAL'
2014-02-26 18:42:35 [DEBUG   ] Got command RPT from MCS: ref #286779
2014-02-26 18:42:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 18:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286779  48 56714 67355522 A NORMALSystem calibrated and operating normally'
2014-02-26 18:42:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-02-26 18:42:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-02-26 18:42:52 [DEBUG   ] Finished updating ant stats in 0.630 seconds
2014-02-26 18:42:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 18:42:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2014-02-26 18:42:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-26 18:42:52 [DEBUG   ] Finished updating board flags in 1.791 seconds
2014-02-26 18:43:12 [DEBUG   ] Finished updating ant stats in 0.575 seconds
2014-02-26 18:43:32 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-26 18:43:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-26 18:43:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-26 18:43:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-02-26 18:43:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 18:43:52 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2014-02-26 18:43:52 [DEBUG   ] Finished updating board flags in 1.389 seconds
2014-02-26 18:44:12 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2014-02-26 18:44:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 18:44:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2014-02-26 18:44:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 18:44:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-26 18:44:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-26 18:44:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 18:44:52 [DEBUG   ] Finished updating board flags in 1.420 seconds
2014-02-26 18:44:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 18:45:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 18:45:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 18:45:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-02-26 18:45:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-26 18:45:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-02-26 18:45:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-02-26 18:45:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-26 18:45:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 18:45:52 [DEBUG   ] Finished updating board flags in 1.380 seconds
2014-02-26 18:45:53 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2014-02-26 18:46:13 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-26 18:46:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 18:46:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-26 18:46:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-26 18:46:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 18:46:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 18:46:52 [DEBUG   ] Finished updating board flags in 1.228 seconds
2014-02-26 18:46:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 18:47:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 18:47:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 18:47:35 [DEBUG   ] Got command RPT from MCS: ref #286795
2014-02-26 18:47:35 [DEBUG   ] summary = NORMAL
2014-02-26 18:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286795  14 56714 67655529 A NORMALNORMAL'
2014-02-26 18:47:35 [DEBUG   ] Got command RPT from MCS: ref #286796
2014-02-26 18:47:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 18:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286796  48 56714 67655530 A NORMALSystem calibrated and operating normally'
2014-02-26 18:47:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 1
2014-02-26 18:47:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2014-02-26 18:47:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2014-02-26 18:47:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 18:47:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-26 18:47:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 18:47:52 [DEBUG   ] Finished updating board flags in 1.139 seconds
2014-02-26 18:47:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 18:48:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-26 18:48:33 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-26 18:48:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-02-26 18:48:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-26 18:48:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-26 18:48:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2014-02-26 18:48:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-26 18:48:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-26 18:48:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 18:48:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-26 18:48:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 18:48:52 [DEBUG   ] Finished updating board flags in 1.018 seconds
2014-02-26 18:48:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 18:49:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 18:49:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 18:49:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-02-26 18:49:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2014-02-26 18:49:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-26 18:49:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-26 18:49:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 4
2014-02-26 18:49:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 18:49:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 18:49:52 [DEBUG   ] Finished updating board flags in 1.006 seconds
2014-02-26 18:49:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 18:50:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 18:50:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 18:50:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-26 18:50:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2014-02-26 18:50:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-26 18:50:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa34, chip 1
2014-02-26 18:50:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 18:50:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2014-02-26 18:50:52 [DEBUG   ] Finished updating board flags in 1.009 seconds
2014-02-26 18:50:53 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-26 18:51:13 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-26 18:51:33 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-26 18:51:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2014-02-26 18:51:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-26 18:51:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-26 18:51:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-26 18:51:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-26 18:51:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-26 18:51:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-02-26 18:51:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 18:51:52 [DEBUG   ] Finished updating board flags in 1.488 seconds
2014-02-26 18:51:53 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-02-26 18:52:13 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2014-02-26 18:52:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 18:52:35 [DEBUG   ] Got command RPT from MCS: ref #286812
2014-02-26 18:52:35 [DEBUG   ] summary = NORMAL
2014-02-26 18:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286812  14 56714 67955529 A NORMALNORMAL'
2014-02-26 18:52:35 [DEBUG   ] Got command RPT from MCS: ref #286813
2014-02-26 18:52:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 18:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286813  48 56714 67955530 A NORMALSystem calibrated and operating normally'
2014-02-26 18:52:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-02-26 18:52:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-26 18:52:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 1
2014-02-26 18:52:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2014-02-26 18:52:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-26 18:52:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-26 18:52:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 18:52:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 3
2014-02-26 18:52:52 [DEBUG   ] Finished updating board flags in 1.361 seconds
2014-02-26 18:52:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 18:53:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 18:53:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 18:53:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-26 18:53:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2014-02-26 18:53:54 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-26 18:53:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-02-26 18:53:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 18:53:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-02-26 18:53:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 18:53:54 [DEBUG   ] Finished updating board flags in 2.893 seconds
2014-02-26 18:54:14 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 18:54:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 18:54:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-26 18:54:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 4
2014-02-26 18:54:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-26 18:54:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-26 18:54:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 18:54:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-26 18:54:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 18:54:53 [DEBUG   ] Finished updating board flags in 1.691 seconds
2014-02-26 18:54:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 18:55:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 18:55:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 18:55:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-26 18:55:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2014-02-26 18:55:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2014-02-26 18:55:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-26 18:55:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 18:55:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-26 18:55:52 [DEBUG   ] Finished updating board flags in 1.016 seconds
2014-02-26 18:55:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 18:56:14 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 18:56:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 18:56:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 18:56:52 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 18:56:52 [DEBUG   ] Finished updating board flags in 1.020 seconds
2014-02-26 18:56:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-26 18:57:14 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 18:57:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 18:57:35 [DEBUG   ] Got command RPT from MCS: ref #286829
2014-02-26 18:57:35 [DEBUG   ] summary = NORMAL
2014-02-26 18:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286829  14 56714 68255529 A NORMALNORMAL'
2014-02-26 18:57:35 [DEBUG   ] Got command RPT from MCS: ref #286830
2014-02-26 18:57:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 18:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286830  48 56714 68255530 A NORMALSystem calibrated and operating normally'
2014-02-26 18:57:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-26 18:57:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-26 18:57:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-26 18:57:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-02-26 18:57:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-26 18:57:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 18:57:52 [DEBUG   ] Finished updating board flags in 0.949 seconds
2014-02-26 18:57:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 18:58:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 18:58:34 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 18:58:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-26 18:58:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-26 18:58:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-26 18:58:53 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 18:58:53 [DEBUG   ] Finished updating board flags in 1.373 seconds
2014-02-26 18:58:54 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-26 18:59:15 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2014-02-26 18:59:34 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-02-26 18:59:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-26 18:59:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 18:59:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 18:59:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 18:59:53 [DEBUG   ] Finished updating board flags in 1.204 seconds
2014-02-26 18:59:54 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2014-02-26 19:00:15 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 19:00:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 19:00:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-26 19:00:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-26 19:00:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-02-26 19:00:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 19:00:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-26 19:00:53 [DEBUG   ] Finished updating board flags in 1.183 seconds
2014-02-26 19:00:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 19:01:15 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 19:01:35 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 19:01:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2014-02-26 19:01:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-26 19:01:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 19:01:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-26 19:01:53 [DEBUG   ] Finished updating board flags in 1.013 seconds
2014-02-26 19:01:55 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2014-02-26 19:02:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 19:02:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 19:02:35 [DEBUG   ] Got command RPT from MCS: ref #286846
2014-02-26 19:02:35 [DEBUG   ] summary = NORMAL
2014-02-26 19:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286846  14 56714 68555533 A NORMALNORMAL'
2014-02-26 19:02:35 [DEBUG   ] Got command RPT from MCS: ref #286847
2014-02-26 19:02:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 19:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286847  48 56714 68555534 A NORMALSystem calibrated and operating normally'
2014-02-26 19:02:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-26 19:02:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-26 19:02:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2014-02-26 19:02:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-26 19:02:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 19:02:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-26 19:02:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 19:02:53 [DEBUG   ] Finished updating board flags in 0.990 seconds
2014-02-26 19:02:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 19:03:15 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 19:03:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 19:03:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2014-02-26 19:03:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-02-26 19:03:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-26 19:03:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-26 19:03:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2014-02-26 19:03:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-26 19:03:54 [DEBUG   ] Finished updating board flags in 1.850 seconds
2014-02-26 19:03:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 19:04:15 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 19:04:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 19:04:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2014-02-26 19:04:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2014-02-26 19:04:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-26 19:04:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-26 19:04:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 19:04:53 [DEBUG   ] Finished updating board flags in 1.224 seconds
2014-02-26 19:04:55 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 19:05:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 19:05:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 19:05:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-26 19:05:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 1
2014-02-26 19:05:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-26 19:05:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 19:05:53 [DEBUG   ] Finished updating board flags in 1.228 seconds
2014-02-26 19:05:55 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-26 19:06:15 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-02-26 19:06:35 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-02-26 19:06:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-26 19:06:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-26 19:06:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-26 19:06:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-26 19:06:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 19:06:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-26 19:06:53 [DEBUG   ] Finished updating board flags in 1.168 seconds
2014-02-26 19:06:55 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-02-26 19:07:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-26 19:07:35 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2014-02-26 19:07:35 [DEBUG   ] Got command RPT from MCS: ref #286863
2014-02-26 19:07:35 [DEBUG   ] summary = NORMAL
2014-02-26 19:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286863  14 56714 68855529 A NORMALNORMAL'
2014-02-26 19:07:35 [DEBUG   ] Got command RPT from MCS: ref #286864
2014-02-26 19:07:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 19:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286864  48 56714 68855530 A NORMALSystem calibrated and operating normally'
2014-02-26 19:07:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-26 19:07:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2014-02-26 19:07:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-02-26 19:07:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-26 19:07:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 19:07:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 19:07:53 [DEBUG   ] Finished updating board flags in 1.028 seconds
2014-02-26 19:07:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 19:08:16 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 19:08:36 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-26 19:08:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-26 19:08:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 19:08:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 19:08:54 [DEBUG   ] Finished updating board flags in 1.537 seconds
2014-02-26 19:08:56 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 19:09:16 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 19:09:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 19:09:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 1
2014-02-26 19:09:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-02-26 19:09:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 19:09:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 19:09:54 [DEBUG   ] Finished updating board flags in 1.407 seconds
2014-02-26 19:09:56 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 19:10:16 [DEBUG   ] Finished updating ant stats in 0.395 seconds
2014-02-26 19:10:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 19:10:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-26 19:10:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2014-02-26 19:10:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2014-02-26 19:10:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-26 19:10:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 19:10:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-02-26 19:10:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-26 19:10:54 [DEBUG   ] Finished updating board flags in 1.380 seconds
2014-02-26 19:10:57 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-26 19:11:17 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 19:11:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 19:11:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-26 19:11:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-26 19:11:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 19:11:54 [DEBUG   ] Finished updating board flags in 1.209 seconds
2014-02-26 19:11:57 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 19:12:17 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 19:12:35 [DEBUG   ] Got command RPT from MCS: ref #286880
2014-02-26 19:12:35 [DEBUG   ] summary = NORMAL
2014-02-26 19:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286880  14 56714 69155538 A NORMALNORMAL'
2014-02-26 19:12:35 [DEBUG   ] Got command RPT from MCS: ref #286881
2014-02-26 19:12:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 19:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286881  48 56714 69155538 A NORMALSystem calibrated and operating normally'
2014-02-26 19:12:37 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 19:12:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-26 19:12:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-26 19:12:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2014-02-26 19:12:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-26 19:12:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-02-26 19:12:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 19:12:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 19:12:54 [DEBUG   ] Finished updating board flags in 1.209 seconds
2014-02-26 19:12:57 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 19:13:17 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2014-02-26 19:13:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 19:13:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2014-02-26 19:13:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-02-26 19:13:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-26 19:13:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 19:13:54 [DEBUG   ] Finished updating board flags in 1.185 seconds
2014-02-26 19:13:58 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 19:14:18 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 19:14:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-26 19:14:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-26 19:14:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2014-02-26 19:14:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-26 19:14:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 19:14:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-26 19:14:54 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 19:14:54 [DEBUG   ] Finished updating board flags in 1.017 seconds
2014-02-26 19:14:58 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2014-02-26 19:15:18 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 19:15:38 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 19:15:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2014-02-26 19:15:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2014-02-26 19:15:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-26 19:15:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-26 19:15:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 19:15:54 [DEBUG   ] Finished updating board flags in 0.981 seconds
2014-02-26 19:15:58 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2014-02-26 19:16:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 19:16:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 19:16:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-26 19:16:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-26 19:16:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2014-02-26 19:16:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-26 19:16:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-02-26 19:16:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-26 19:16:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 19:16:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-26 19:16:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-26 19:16:54 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 19:16:54 [DEBUG   ] Finished updating board flags in 1.282 seconds
2014-02-26 19:16:59 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 19:17:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 19:17:35 [DEBUG   ] Got command RPT from MCS: ref #286897
2014-02-26 19:17:35 [DEBUG   ] summary = NORMAL
2014-02-26 19:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286897  14 56714 69455534 A NORMALNORMAL'
2014-02-26 19:17:35 [DEBUG   ] Got command RPT from MCS: ref #286898
2014-02-26 19:17:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 19:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286898  48 56714 69455534 A NORMALSystem calibrated and operating normally'
2014-02-26 19:17:39 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 19:17:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-26 19:17:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-26 19:17:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-26 19:17:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-26 19:17:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-26 19:17:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-26 19:17:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 19:17:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-26 19:17:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 19:17:54 [DEBUG   ] Finished updating board flags in 1.169 seconds
2014-02-26 19:17:59 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 19:18:19 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 19:18:39 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 19:18:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-26 19:18:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-26 19:18:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-26 19:18:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 19:18:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 19:18:54 [DEBUG   ] Finished updating board flags in 1.028 seconds
2014-02-26 19:18:59 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 19:19:19 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2014-02-26 19:19:39 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2014-02-26 19:19:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-26 19:19:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-26 19:19:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2014-02-26 19:19:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-26 19:19:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-02-26 19:19:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 19:19:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-26 19:19:54 [DEBUG   ] Finished updating board flags in 0.970 seconds
2014-02-26 19:20:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 19:20:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-26 19:20:40 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 19:20:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-26 19:20:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-26 19:20:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2014-02-26 19:20:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-26 19:20:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 19:20:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2014-02-26 19:20:55 [DEBUG   ] Finished updating board flags in 1.381 seconds
2014-02-26 19:21:00 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2014-02-26 19:21:20 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 19:21:40 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 19:21:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa12, chip 1
2014-02-26 19:21:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2014-02-26 19:21:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-26 19:21:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2014-02-26 19:21:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 19:21:55 [DEBUG   ] Finished updating board flags in 1.182 seconds
2014-02-26 19:22:00 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 19:22:20 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 19:22:35 [DEBUG   ] Got command RPT from MCS: ref #286914
2014-02-26 19:22:35 [DEBUG   ] summary = NORMAL
2014-02-26 19:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286914  14 56714 69755538 A NORMALNORMAL'
2014-02-26 19:22:35 [DEBUG   ] Got command RPT from MCS: ref #286915
2014-02-26 19:22:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 19:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286915  48 56714 69755538 A NORMALSystem calibrated and operating normally'
2014-02-26 19:22:40 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 19:22:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-26 19:22:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2014-02-26 19:22:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-26 19:22:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-02-26 19:22:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 19:22:55 [DEBUG   ] Finished updating board flags in 1.013 seconds
2014-02-26 19:23:00 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2014-02-26 19:23:20 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2014-02-26 19:23:40 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2014-02-26 19:23:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-26 19:23:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 19:23:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-02-26 19:23:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 19:23:55 [DEBUG   ] Finished updating board flags in 0.990 seconds
2014-02-26 19:24:00 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2014-02-26 19:24:20 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2014-02-26 19:24:40 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2014-02-26 19:24:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-26 19:24:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-26 19:24:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-26 19:24:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-26 19:24:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 1
2014-02-26 19:24:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2014-02-26 19:24:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-26 19:24:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-26 19:24:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 19:24:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 19:24:56 [DEBUG   ] Finished updating board flags in 1.836 seconds
2014-02-26 19:25:00 [DEBUG   ] Finished updating ant stats in 0.397 seconds
2014-02-26 19:25:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 19:25:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 19:25:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2014-02-26 19:25:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-26 19:25:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-26 19:25:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 19:25:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-26 19:25:55 [DEBUG   ] Finished updating board flags in 1.210 seconds
2014-02-26 19:26:01 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 19:26:21 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 19:26:41 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 19:26:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-26 19:26:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-26 19:26:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2014-02-26 19:26:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-26 19:26:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-26 19:26:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-26 19:26:56 [DEBUG   ] Finished updating board flags in 1.830 seconds
2014-02-26 19:27:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 19:27:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 19:27:35 [DEBUG   ] Got command RPT from MCS: ref #286931
2014-02-26 19:27:35 [DEBUG   ] summary = NORMAL
2014-02-26 19:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286931  14 56714 70055537 A NORMALNORMAL'
2014-02-26 19:27:35 [DEBUG   ] Got command RPT from MCS: ref #286932
2014-02-26 19:27:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 19:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286932  48 56714 70055538 A NORMALSystem calibrated and operating normally'
2014-02-26 19:27:41 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 19:27:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-26 19:27:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-26 19:27:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2014-02-26 19:27:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 4
2014-02-26 19:27:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 19:27:56 [DEBUG   ] Finished updating board flags in 1.739 seconds
2014-02-26 19:28:00 [DEBUG   ] Got command INI from MCS: ref #286948
2014-02-26 19:28:00 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2014-02-26 19:28:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   286948   8 56714 70080314 ABOOTING'
2014-02-26 19:28:01 [DEBUG   ] Finished updating ant stats in 0.827 seconds
2014-02-26 19:28:20 [INFO    ] -------------------
2014-02-26 19:28:20 [INFO    ]  LWA board status
2014-02-26 19:28:20 [INFO    ] -------------------
2014-02-26 19:28:20 [INFO    ] DP 1: 2 lwa27
2014-02-26 19:28:20 [INFO    ] DP 1: 3 lwa24
2014-02-26 19:28:20 [INFO    ] DP 1: 4 lwa23
2014-02-26 19:28:20 [INFO    ] DP 1: 5 lwa18
2014-02-26 19:28:20 [INFO    ] DP 1: 6 lwa10
2014-02-26 19:28:20 [INFO    ] DP 1: 7 lwa32
2014-02-26 19:28:20 [INFO    ] DP 1: 8 lwa11
2014-02-26 19:28:20 [INFO    ] DP 1: 9 lwa30
2014-02-26 19:28:20 [INFO    ] DP 1: 10 lwa12
2014-02-26 19:28:20 [INFO    ] DP 1: 11 lwa8
2014-02-26 19:28:20 [INFO    ] DP 1: 12 lwa13
2014-02-26 19:28:20 [INFO    ] DP 1: 13 lwa26
2014-02-26 19:28:20 [INFO    ] DP 1: 14 lwa14
2014-02-26 19:28:20 [INFO    ] DP 1: 16 lwa22
2014-02-26 19:28:20 [INFO    ] DP 1: 17 lwa20
2014-02-26 19:28:20 [INFO    ] DP 1: 18 lwa1
2014-02-26 19:28:20 [INFO    ] DP 1: 19 lwa5
2014-02-26 19:28:20 [INFO    ] DP 1: 20 lwa25
2014-02-26 19:28:20 [INFO    ] DP 1: 21 lwa35
2014-02-26 19:28:20 [INFO    ] DP 1: 22 lwa19
2014-02-26 19:28:20 [INFO    ] DP 1: 23 lwa21
2014-02-26 19:28:20 [INFO    ] DP 1: 24 lwa6
2014-02-26 19:28:20 [INFO    ] DP 1: 25 lwa7
2014-02-26 19:28:20 [INFO    ] DP 1: 26 lwa33
2014-02-26 19:28:20 [INFO    ] DP 1: 27 lwa15
2014-02-26 19:28:20 [INFO    ] DP 1: 28 lwa28
2014-02-26 19:28:20 [INFO    ] DP 2: 1 lwa16
2014-02-26 19:28:20 [INFO    ] DP 2: 15 lwa34
2014-02-26 19:28:20 [INFO    ] Total of 28 boards
2014-02-26 19:28:20 [INFO    ] Total of 260 stands
2014-02-26 19:28:20 [INFO    ] -------------------
2014-02-26 19:28:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2014-02-26 19:28:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2014-02-26 19:28:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2014-02-26 19:28:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2014-02-26 19:28:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2014-02-26 19:28:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2014-02-26 19:28:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2014-02-26 19:28:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2014-02-26 19:28:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2014-02-26 19:28:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2014-02-26 19:28:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2014-02-26 19:28:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2014-02-26 19:28:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2014-02-26 19:28:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2014-02-26 19:28:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2014-02-26 19:28:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2014-02-26 19:28:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2014-02-26 19:28:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2014-02-26 19:28:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2014-02-26 19:28:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2014-02-26 19:28:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2014-02-26 19:28:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2014-02-26 19:28:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2014-02-26 19:28:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2014-02-26 19:28:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2014-02-26 19:28:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2014-02-26 19:28:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2014-02-26 19:28:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2014-02-26 19:28:27 [DEBUG   ] 2014-02-26 19:28:27 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1328
2014-02-26 19:28:27 [DEBUG   ] 2014-02-26 19:28:27 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1329
2014-02-26 19:28:27 [DEBUG   ] 2014-02-26 19:28:27 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1330
2014-02-26 19:28:27 [DEBUG   ] 2014-02-26 19:28:27 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1331
2014-02-26 19:28:27 [DEBUG   ] 2014-02-26 19:28:27 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1332
2014-02-26 19:28:27 [DEBUG   ] 2014-02-26 19:28:27 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1333
2014-02-26 19:28:27 [DEBUG   ] 2014-02-26 19:28:27 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1334
2014-02-26 19:28:27 [DEBUG   ] 2014-02-26 19:28:27 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1335
2014-02-26 19:28:27 [DEBUG   ] 2014-02-26 19:28:27 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1336
2014-02-26 19:28:27 [DEBUG   ] 2014-02-26 19:28:27 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1337
2014-02-26 19:28:27 [DEBUG   ] 2014-02-26 19:28:27 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1338
2014-02-26 19:28:27 [DEBUG   ] 2014-02-26 19:28:27 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1339
2014-02-26 19:28:27 [DEBUG   ] 2014-02-26 19:28:27 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1340
2014-02-26 19:28:27 [DEBUG   ] 2014-02-26 19:28:27 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1341
2014-02-26 19:28:27 [DEBUG   ] 2014-02-26 19:28:27 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1342
2014-02-26 19:28:27 [DEBUG   ] 2014-02-26 19:28:27 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1343
2014-02-26 19:28:27 [DEBUG   ] 2014-02-26 19:28:27 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1344
2014-02-26 19:28:27 [DEBUG   ] 2014-02-26 19:28:27 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1345
2014-02-26 19:28:27 [DEBUG   ] 2014-02-26 19:28:27 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1346
2014-02-26 19:28:27 [DEBUG   ] 2014-02-26 19:28:27 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1347
2014-02-26 19:28:27 [DEBUG   ] 2014-02-26 19:28:27 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1348
2014-02-26 19:28:27 [DEBUG   ] 2014-02-26 19:28:27 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1349
2014-02-26 19:28:27 [DEBUG   ] 2014-02-26 19:28:27 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1350
2014-02-26 19:28:27 [DEBUG   ] 2014-02-26 19:28:27 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1351
2014-02-26 19:28:27 [DEBUG   ] 2014-02-26 19:28:27 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1352
2014-02-26 19:28:27 [DEBUG   ] 2014-02-26 19:28:27 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1353
2014-02-26 19:28:39 [DEBUG   ] 2014-02-26 19:28:39 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1328 exited with status 0
2014-02-26 19:28:39 [DEBUG   ] 2014-02-26 19:28:39 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1329 exited with status 0
2014-02-26 19:28:39 [DEBUG   ] 2014-02-26 19:28:39 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1330 exited with status 0
2014-02-26 19:28:39 [DEBUG   ] 2014-02-26 19:28:39 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1331 exited with status 0
2014-02-26 19:28:39 [DEBUG   ] 2014-02-26 19:28:39 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1332 exited with status 0
2014-02-26 19:28:39 [DEBUG   ] 2014-02-26 19:28:39 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1333 exited with status 0
2014-02-26 19:28:39 [DEBUG   ] 2014-02-26 19:28:39 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1334 exited with status 0
2014-02-26 19:28:39 [DEBUG   ] 2014-02-26 19:28:39 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1335 exited with status 0
2014-02-26 19:28:39 [DEBUG   ] 2014-02-26 19:28:39 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1336 exited with status 0
2014-02-26 19:28:39 [DEBUG   ] 2014-02-26 19:28:39 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1337 exited with status 0
2014-02-26 19:28:39 [DEBUG   ] 2014-02-26 19:28:39 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1338 exited with status 0
2014-02-26 19:28:39 [DEBUG   ] 2014-02-26 19:28:39 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1339 exited with status 0
2014-02-26 19:28:39 [DEBUG   ] 2014-02-26 19:28:39 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1340 exited with status 0
2014-02-26 19:28:39 [DEBUG   ] 2014-02-26 19:28:39 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1341 exited with status 0
2014-02-26 19:28:39 [DEBUG   ] 2014-02-26 19:28:39 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1342 exited with status 0
2014-02-26 19:28:39 [DEBUG   ] 2014-02-26 19:28:39 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1343 exited with status 0
2014-02-26 19:28:39 [DEBUG   ] 2014-02-26 19:28:39 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1344 exited with status 0
2014-02-26 19:28:39 [DEBUG   ] 2014-02-26 19:28:39 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1345 exited with status 0
2014-02-26 19:28:39 [DEBUG   ] 2014-02-26 19:28:39 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1346 exited with status 0
2014-02-26 19:28:39 [DEBUG   ] 2014-02-26 19:28:39 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1347 exited with status 0
2014-02-26 19:28:39 [DEBUG   ] 2014-02-26 19:28:39 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1348 exited with status 0
2014-02-26 19:28:39 [DEBUG   ] 2014-02-26 19:28:39 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1349 exited with status 0
2014-02-26 19:28:39 [DEBUG   ] 2014-02-26 19:28:39 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1350 exited with status 0
2014-02-26 19:28:39 [DEBUG   ] 2014-02-26 19:28:39 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1351 exited with status 0
2014-02-26 19:28:39 [DEBUG   ] 2014-02-26 19:28:39 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1352 exited with status 0
2014-02-26 19:28:39 [DEBUG   ] 2014-02-26 19:28:39 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1353 exited with status 0
2014-02-26 19:28:39 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2014-02-26 19:28:39 [DEBUG   ] spawn_process: at 2014-02-26 19:28:39 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2014-02-26 19:28:39 [DEBUG   ] spawn_process: at 2014-02-26 19:28:39 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2014-02-26 19:28:39 [DEBUG   ] spawn_process: at 2014-02-26 19:28:39 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2014-02-26 19:28:39 [DEBUG   ] spawn_process: at 2014-02-26 19:28:39 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2014-02-26 19:28:39 [DEBUG   ] spawn_process: at 2014-02-26 19:28:39 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2014-02-26 19:28:39 [DEBUG   ] spawn_process: at 2014-02-26 19:28:39 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2014-02-26 19:28:39 [DEBUG   ] spawn_process: at 2014-02-26 19:28:39 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2014-02-26 19:28:39 [DEBUG   ] spawn_process: at 2014-02-26 19:28:39 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2014-02-26 19:28:39 [DEBUG   ] spawn_process: at 2014-02-26 19:28:39 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2014-02-26 19:28:39 [DEBUG   ] spawn_process: at 2014-02-26 19:28:39 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2014-02-26 19:28:39 [DEBUG   ] spawn_process: at 2014-02-26 19:28:39 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2014-02-26 19:28:39 [DEBUG   ] spawn_process: at 2014-02-26 19:28:39 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2014-02-26 19:28:39 [DEBUG   ] spawn_process: at 2014-02-26 19:28:39 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2014-02-26 19:28:39 [DEBUG   ] spawn_process: at 2014-02-26 19:28:39 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2014-02-26 19:28:39 [DEBUG   ] spawn_process: at 2014-02-26 19:28:39 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2014-02-26 19:28:39 [DEBUG   ] spawn_process: at 2014-02-26 19:28:39 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2014-02-26 19:28:39 [DEBUG   ] spawn_process: at 2014-02-26 19:28:39 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2014-02-26 19:28:39 [DEBUG   ] spawn_process: at 2014-02-26 19:28:39 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2014-02-26 19:28:39 [DEBUG   ] spawn_process: at 2014-02-26 19:28:39 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2014-02-26 19:28:39 [DEBUG   ] spawn_process: at 2014-02-26 19:28:39 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2014-02-26 19:28:39 [DEBUG   ] spawn_process: at 2014-02-26 19:28:39 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2014-02-26 19:28:39 [DEBUG   ] spawn_process: at 2014-02-26 19:28:39 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2014-02-26 19:28:39 [DEBUG   ] spawn_process: at 2014-02-26 19:28:39 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2014-02-26 19:28:39 [DEBUG   ] spawn_process: at 2014-02-26 19:28:39 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2014-02-26 19:28:39 [DEBUG   ] spawn_process: at 2014-02-26 19:28:39 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2014-02-26 19:28:39 [DEBUG   ] spawn_process: at 2014-02-26 19:28:39 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2014-02-26 19:28:39 [DEBUG   ] 2014-02-26 19:28:39 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 1380
2014-02-26 19:28:39 [DEBUG   ] 2014-02-26 19:28:39 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 1381
2014-02-26 19:28:45 [DEBUG   ] 2014-02-26 19:28:45 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 1380 exited with status 0
2014-02-26 19:28:45 [DEBUG   ] 2014-02-26 19:28:45 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 1381 exited with status 0
2014-02-26 19:28:45 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2014-02-26 19:28:45 [DEBUG   ] spawn_process: at 2014-02-26 19:28:45 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2014-02-26 19:28:45 [DEBUG   ] spawn_process: at 2014-02-26 19:28:45 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2014-02-26 19:28:45 [INFO    ] Setting Beam 1 xbars
2014-02-26 19:28:45 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2014-02-26 19:28:45 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2014-02-26 19:28:45 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2014-02-26 19:28:45 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2014-02-26 19:28:45 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2014-02-26 19:28:46 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2014-02-26 19:28:46 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2014-02-26 19:28:46 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2014-02-26 19:28:46 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2014-02-26 19:28:46 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2014-02-26 19:28:46 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2014-02-26 19:28:46 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2014-02-26 19:28:46 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2014-02-26 19:28:46 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2014-02-26 19:28:47 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2014-02-26 19:28:47 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2014-02-26 19:28:47 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2014-02-26 19:28:47 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2014-02-26 19:28:47 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2014-02-26 19:28:47 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2014-02-26 19:28:47 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2014-02-26 19:28:47 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2014-02-26 19:28:47 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2014-02-26 19:28:48 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2014-02-26 19:28:48 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2014-02-26 19:28:48 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2014-02-26 19:28:48 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2014-02-26 19:28:48 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2014-02-26 19:28:48 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2014-02-26 19:28:48 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2014-02-26 19:28:48 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2014-02-26 19:28:48 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2014-02-26 19:28:48 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2014-02-26 19:28:49 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2014-02-26 19:28:49 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2014-02-26 19:28:49 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2014-02-26 19:28:49 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2014-02-26 19:28:49 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2014-02-26 19:28:49 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2014-02-26 19:28:49 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2014-02-26 19:28:49 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2014-02-26 19:28:49 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2014-02-26 19:28:50 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2014-02-26 19:28:50 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2014-02-26 19:28:50 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2014-02-26 19:28:50 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2014-02-26 19:28:50 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2014-02-26 19:28:50 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2014-02-26 19:28:50 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2014-02-26 19:28:50 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2014-02-26 19:28:50 [INFO    ] Setting Beam 2 xbars
2014-02-26 19:28:50 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2014-02-26 19:28:51 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2014-02-26 19:28:51 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2014-02-26 19:28:51 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2014-02-26 19:28:51 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2014-02-26 19:28:51 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2014-02-26 19:28:51 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2014-02-26 19:28:51 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2014-02-26 19:28:51 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2014-02-26 19:28:51 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2014-02-26 19:28:52 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2014-02-26 19:28:52 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2014-02-26 19:28:52 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2014-02-26 19:28:52 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2014-02-26 19:28:52 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2014-02-26 19:28:52 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2014-02-26 19:28:52 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2014-02-26 19:28:52 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2014-02-26 19:28:52 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2014-02-26 19:28:53 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2014-02-26 19:28:53 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2014-02-26 19:28:53 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2014-02-26 19:28:53 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2014-02-26 19:28:53 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2014-02-26 19:28:53 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2014-02-26 19:28:53 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2014-02-26 19:28:53 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2014-02-26 19:28:53 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2014-02-26 19:28:53 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2014-02-26 19:28:54 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2014-02-26 19:28:54 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2014-02-26 19:28:54 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2014-02-26 19:28:54 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2014-02-26 19:28:54 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2014-02-26 19:28:54 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2014-02-26 19:28:54 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2014-02-26 19:28:54 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2014-02-26 19:28:54 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2014-02-26 19:28:55 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2014-02-26 19:28:55 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2014-02-26 19:28:55 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2014-02-26 19:28:55 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2014-02-26 19:28:55 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2014-02-26 19:28:55 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2014-02-26 19:28:55 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2014-02-26 19:28:55 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2014-02-26 19:28:55 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2014-02-26 19:28:56 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2014-02-26 19:28:56 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2014-02-26 19:28:56 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2014-02-26 19:28:56 [INFO    ] Setting Beam 3 xbars
2014-02-26 19:28:56 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2014-02-26 19:28:56 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2014-02-26 19:28:56 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2014-02-26 19:28:56 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2014-02-26 19:28:56 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2014-02-26 19:28:56 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2014-02-26 19:28:57 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2014-02-26 19:28:57 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2014-02-26 19:28:57 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2014-02-26 19:28:57 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2014-02-26 19:28:57 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2014-02-26 19:28:57 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2014-02-26 19:28:57 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2014-02-26 19:28:57 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2014-02-26 19:28:57 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2014-02-26 19:28:58 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2014-02-26 19:28:58 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2014-02-26 19:28:58 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2014-02-26 19:28:58 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2014-02-26 19:28:58 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2014-02-26 19:28:58 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2014-02-26 19:28:58 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2014-02-26 19:28:58 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2014-02-26 19:28:58 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2014-02-26 19:28:58 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2014-02-26 19:28:59 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2014-02-26 19:28:59 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2014-02-26 19:28:59 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2014-02-26 19:28:59 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2014-02-26 19:28:59 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2014-02-26 19:28:59 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2014-02-26 19:28:59 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2014-02-26 19:28:59 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2014-02-26 19:28:59 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2014-02-26 19:29:00 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2014-02-26 19:29:00 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2014-02-26 19:29:00 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2014-02-26 19:29:00 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2014-02-26 19:29:00 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2014-02-26 19:29:00 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2014-02-26 19:29:00 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2014-02-26 19:29:00 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2014-02-26 19:29:00 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2014-02-26 19:29:01 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2014-02-26 19:29:01 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2014-02-26 19:29:01 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2014-02-26 19:29:01 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2014-02-26 19:29:01 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2014-02-26 19:29:01 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2014-02-26 19:29:01 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2014-02-26 19:29:01 [INFO    ] Setting Beam 4 xbars
2014-02-26 19:29:01 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2014-02-26 19:29:01 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2014-02-26 19:29:02 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2014-02-26 19:29:02 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2014-02-26 19:29:02 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2014-02-26 19:29:02 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2014-02-26 19:29:02 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2014-02-26 19:29:02 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2014-02-26 19:29:02 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2014-02-26 19:29:02 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2014-02-26 19:29:02 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2014-02-26 19:29:03 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2014-02-26 19:29:03 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2014-02-26 19:29:03 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2014-02-26 19:29:03 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2014-02-26 19:29:03 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2014-02-26 19:29:03 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2014-02-26 19:29:03 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2014-02-26 19:29:03 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2014-02-26 19:29:03 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2014-02-26 19:29:04 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2014-02-26 19:29:04 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2014-02-26 19:29:04 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2014-02-26 19:29:04 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2014-02-26 19:29:04 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2014-02-26 19:29:04 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2014-02-26 19:29:04 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2014-02-26 19:29:04 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2014-02-26 19:29:04 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2014-02-26 19:29:05 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2014-02-26 19:29:05 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2014-02-26 19:29:05 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2014-02-26 19:29:05 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2014-02-26 19:29:05 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2014-02-26 19:29:05 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2014-02-26 19:29:05 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2014-02-26 19:29:05 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2014-02-26 19:29:05 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2014-02-26 19:29:05 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2014-02-26 19:29:06 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2014-02-26 19:29:06 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2014-02-26 19:29:06 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2014-02-26 19:29:06 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2014-02-26 19:29:06 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2014-02-26 19:29:06 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2014-02-26 19:29:06 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2014-02-26 19:29:06 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2014-02-26 19:29:06 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2014-02-26 19:29:07 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2014-02-26 19:29:07 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2014-02-26 19:29:07 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2014-02-26 19:29:07 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2014-02-26 19:29:07 [INFO    ] All xbars set
2014-02-26 19:29:07 [INFO    ] Setting adder chain routing for all beams
2014-02-26 19:29:12 [INFO    ] Setting beam ids
2014-02-26 19:29:22 [INFO    ] Starting beam delay calibration
2014-02-26 19:29:34 [INFO    ] Beam 1 latency is 5731
2014-02-26 19:29:34 [INFO    ] Beam 2 latency is 5776
2014-02-26 19:29:34 [INFO    ] Beam 3 latency is 5753
2014-02-26 19:29:34 [INFO    ] Beam 4 latency is 5732
2014-02-26 19:29:34 [INFO    ] Stop calibration
2014-02-26 19:29:42 [INFO    ] Beam delay calibration successful
2014-02-26 19:29:42 [INFO    ] Calibration passed
2014-02-26 19:29:42 [DEBUG   ] spawn_process: at 2014-02-26 19:29:42 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2014-02-26 19:29:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2014-02-26 19:29:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2014-02-26 19:29:42 [DEBUG   ] spawn_process: at 2014-02-26 19:29:42 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2014-02-26 19:29:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2014-02-26 19:29:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2014-02-26 19:29:42 [DEBUG   ] spawn_process: at 2014-02-26 19:29:42 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2014-02-26 19:29:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2014-02-26 19:29:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2014-02-26 19:29:42 [DEBUG   ] spawn_process: at 2014-02-26 19:29:42 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2014-02-26 19:29:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2014-02-26 19:29:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2014-02-26 19:29:42 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -4 msec
2014-02-26 19:29:43 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 290 ms (1393442983.295 s) with PID 2977 and time 1393442984
2014-02-26 19:29:43 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -4 msec
2014-02-26 19:29:43 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 378 ms (1393442983.382 s) with PID 2980 and time 1393442984
2014-02-26 19:29:44 [DEBUG   ] Finished updating ant stats in 0.868 seconds
2014-02-26 19:29:44 [INFO    ] Started antennas statistics background thread
2014-02-26 19:29:44 [INFO    ] Started board flags background thread
2014-02-26 19:29:44 [INFO    ] Started BAM background thread
2014-02-26 19:29:44 [INFO    ] Finished the INI process (ref. #286948) in 104.192 s
2014-02-26 19:29:45 [DEBUG   ] Finished updating board flags in 1.052 seconds
2014-02-26 19:30:04 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 19:30:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 19:30:44 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 19:30:45 [DEBUG   ] Finished updating board flags in 1.007 seconds
2014-02-26 19:31:04 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 19:31:24 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 19:31:44 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 19:31:45 [DEBUG   ] Finished updating board flags in 1.014 seconds
2014-02-26 19:32:04 [DEBUG   ] Finished updating ant stats in 0.792 seconds
2014-02-26 19:32:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 19:32:35 [DEBUG   ] Got command RPT from MCS: ref #286949
2014-02-26 19:32:35 [DEBUG   ] summary = NORMAL
2014-02-26 19:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286949  14 56714 70355541 A NORMALNORMAL'
2014-02-26 19:32:35 [DEBUG   ] Got command RPT from MCS: ref #286950
2014-02-26 19:32:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 19:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286950  48 56714 70355542 A NORMALSystem calibrated and operating normally'
2014-02-26 19:32:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 19:32:45 [DEBUG   ] Finished updating board flags in 1.465 seconds
2014-02-26 19:33:00 [DEBUG   ] Got command RPT from MCS: ref #286966
2014-02-26 19:33:00 [DEBUG   ] summary = NORMAL
2014-02-26 19:33:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286966  14 56714 70380305 A NORMALNORMAL'
2014-02-26 19:33:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 19:33:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 19:33:44 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 19:33:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 19:33:46 [DEBUG   ] Finished updating board flags in 1.963 seconds
2014-02-26 19:34:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 19:34:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 19:34:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 19:34:45 [DEBUG   ] Finished updating board flags in 1.243 seconds
2014-02-26 19:35:04 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 19:35:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 19:35:44 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 19:35:46 [DEBUG   ] Finished updating board flags in 1.758 seconds
2014-02-26 19:36:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 19:36:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 19:36:44 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 19:36:45 [DEBUG   ] Finished updating board flags in 1.000 seconds
2014-02-26 19:37:04 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 19:37:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 19:37:35 [DEBUG   ] Got command RPT from MCS: ref #286967
2014-02-26 19:37:35 [DEBUG   ] summary = NORMAL
2014-02-26 19:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286967  14 56714 70655537 A NORMALNORMAL'
2014-02-26 19:37:35 [DEBUG   ] Got command RPT from MCS: ref #286968
2014-02-26 19:37:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 19:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286968  48 56714 70655538 A NORMALSystem calibrated and operating normally'
2014-02-26 19:37:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 19:37:46 [DEBUG   ] Finished updating board flags in 1.375 seconds
2014-02-26 19:38:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 19:38:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 19:38:44 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 19:38:46 [DEBUG   ] Finished updating board flags in 1.249 seconds
2014-02-26 19:39:04 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 19:39:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 19:39:44 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 19:39:46 [DEBUG   ] Finished updating board flags in 1.134 seconds
2014-02-26 19:40:04 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 19:40:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 19:40:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 19:40:46 [DEBUG   ] Finished updating board flags in 1.048 seconds
2014-02-26 19:41:04 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 19:41:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 19:41:44 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 19:41:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 19:41:47 [DEBUG   ] Finished updating board flags in 1.999 seconds
2014-02-26 19:42:04 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2014-02-26 19:42:24 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2014-02-26 19:42:35 [DEBUG   ] Got command RPT from MCS: ref #286984
2014-02-26 19:42:35 [DEBUG   ] summary = NORMAL
2014-02-26 19:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286984  14 56714 70955545 A NORMALNORMAL'
2014-02-26 19:42:35 [DEBUG   ] Got command RPT from MCS: ref #286985
2014-02-26 19:42:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 19:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286985  48 56714 70955546 A NORMALSystem calibrated and operating normally'
2014-02-26 19:42:44 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2014-02-26 19:42:47 [DEBUG   ] Finished updating board flags in 1.757 seconds
2014-02-26 19:43:04 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2014-02-26 19:43:24 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2014-02-26 19:43:44 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2014-02-26 19:43:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 19:43:46 [DEBUG   ] Finished updating board flags in 1.059 seconds
2014-02-26 19:44:04 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2014-02-26 19:44:24 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2014-02-26 19:44:45 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-02-26 19:44:46 [DEBUG   ] Finished updating board flags in 1.008 seconds
2014-02-26 19:45:00 [DEBUG   ] Got command TBN from MCS: ref #287001
2014-02-26 19:45:00 [DEBUG   ] spawn_process: at 2014-02-26 19:45:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '1', '1393443901']
2014-02-26 19:45:00 [DEBUG   ] spawn_process: at 2014-02-26 19:45:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '2', '1393443901']
2014-02-26 19:45:00 [DEBUG   ] tbn = exited with status True, code 0x00
2014-02-26 19:45:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   287001   8 56714 71100326 A NORMAL'
2014-02-26 19:45:00 [DEBUG   ] spawn_process: at 2014-02-26 19:45:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '3', '1393443901']
2014-02-26 19:45:00 [DEBUG   ] spawn_process: at 2014-02-26 19:45:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '4', '1393443901']
2014-02-26 19:45:00 [DEBUG   ] spawn_process: at 2014-02-26 19:45:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '5', '1393443901']
2014-02-26 19:45:00 [DEBUG   ] spawn_process: at 2014-02-26 19:45:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '6', '1393443901']
2014-02-26 19:45:00 [DEBUG   ] spawn_process: at 2014-02-26 19:45:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '7', '1393443901']
2014-02-26 19:45:00 [DEBUG   ] spawn_process: at 2014-02-26 19:45:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '8', '1393443901']
2014-02-26 19:45:00 [DEBUG   ] spawn_process: at 2014-02-26 19:45:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '9', '1393443901']
2014-02-26 19:45:00 [DEBUG   ] spawn_process: at 2014-02-26 19:45:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '10', '1393443901']
2014-02-26 19:45:00 [DEBUG   ] spawn_process: at 2014-02-26 19:45:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '11', '1393443901']
2014-02-26 19:45:00 [DEBUG   ] spawn_process: at 2014-02-26 19:45:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '12', '1393443901']
2014-02-26 19:45:00 [DEBUG   ] spawn_process: at 2014-02-26 19:45:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '13', '1393443901']
2014-02-26 19:45:00 [DEBUG   ] spawn_process: at 2014-02-26 19:45:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '14', '1393443901']
2014-02-26 19:45:00 [DEBUG   ] spawn_process: at 2014-02-26 19:45:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '15', '1393443901']
2014-02-26 19:45:00 [DEBUG   ] spawn_process: at 2014-02-26 19:45:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '16', '1393443901']
2014-02-26 19:45:00 [DEBUG   ] spawn_process: at 2014-02-26 19:45:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '17', '1393443901']
2014-02-26 19:45:00 [DEBUG   ] spawn_process: at 2014-02-26 19:45:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '18', '1393443901']
2014-02-26 19:45:00 [DEBUG   ] spawn_process: at 2014-02-26 19:45:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '19', '1393443901']
2014-02-26 19:45:00 [DEBUG   ] spawn_process: at 2014-02-26 19:45:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '20', '1393443901']
2014-02-26 19:45:00 [DEBUG   ] spawn_process: at 2014-02-26 19:45:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '21', '1393443901']
2014-02-26 19:45:00 [DEBUG   ] spawn_process: at 2014-02-26 19:45:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '22', '1393443901']
2014-02-26 19:45:00 [DEBUG   ] spawn_process: at 2014-02-26 19:45:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '23', '1393443901']
2014-02-26 19:45:00 [DEBUG   ] spawn_process: at 2014-02-26 19:45:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '24', '1393443901']
2014-02-26 19:45:00 [DEBUG   ] spawn_process: at 2014-02-26 19:45:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '25', '1393443901']
2014-02-26 19:45:00 [DEBUG   ] spawn_process: at 2014-02-26 19:45:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '26', '1393443901']
2014-02-26 19:45:00 [INFO    ] Finished spawning TBN in 0.048 s
2014-02-26 19:45:04 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2014-02-26 19:45:25 [DEBUG   ] Finished updating ant stats in 1.268 seconds
2014-02-26 19:45:45 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 19:45:47 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 19:45:47 [DEBUG   ] Finished updating board flags in 1.856 seconds
2014-02-26 19:46:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 19:46:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 19:46:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-26 19:46:47 [DEBUG   ] Finished updating board flags in 1.702 seconds
2014-02-26 19:47:05 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 19:47:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-26 19:47:35 [DEBUG   ] Got command RPT from MCS: ref #287002
2014-02-26 19:47:35 [DEBUG   ] summary = NORMAL
2014-02-26 19:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287002  14 56714 71255545 A NORMALNORMAL'
2014-02-26 19:47:35 [DEBUG   ] Got command RPT from MCS: ref #287003
2014-02-26 19:47:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-26 19:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287003  48 56714 71255546 A NORMALSystem calibrated and operating normally'
2014-02-26 19:47:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 19:47:47 [DEBUG   ] Finished updating board flags in 1.621 seconds
2014-02-26 19:48:05 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 19:48:25 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 19:48:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 19:48:47 [DEBUG   ] Finished updating board flags in 1.617 seconds
2014-02-26 19:49:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 19:49:25 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 19:49:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 19:49:47 [DEBUG   ] Finished updating board flags in 1.574 seconds
2014-02-26 19:50:05 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2014-02-26 19:50:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 19:50:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 19:50:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2014-02-26 19:50:47 [CRITICAL] MGT underflow detected on beam(s) 1
2014-02-26 19:50:47 [DEBUG   ] Finished updating board flags in 1.406 seconds
2014-02-26 19:51:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 19:51:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 19:51:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 19:51:47 [DEBUG   ] Finished updating board flags in 1.544 seconds
2014-02-26 19:52:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 19:52:25 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-26 19:52:35 [DEBUG   ] Got command RPT from MCS: ref #287019
2014-02-26 19:52:35 [DEBUG   ] summary = ERROR
2014-02-26 19:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287019  13 56714 71555545 A  ERRORERROR'
2014-02-26 19:52:35 [DEBUG   ] Got command RPT from MCS: ref #287020
2014-02-26 19:52:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 19:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287020  77 56714 71555546 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 19:52:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 19:52:47 [DEBUG   ] Finished updating board flags in 1.533 seconds
2014-02-26 19:53:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 19:53:25 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 19:53:45 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 19:53:48 [DEBUG   ] Finished updating board flags in 2.214 seconds
2014-02-26 19:54:05 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2014-02-26 19:54:25 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-26 19:54:45 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2014-02-26 19:54:48 [DEBUG   ] Finished updating board flags in 2.106 seconds
2014-02-26 19:55:06 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-02-26 19:55:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-26 19:55:46 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 19:55:48 [DEBUG   ] Finished updating board flags in 2.024 seconds
2014-02-26 19:56:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 19:56:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 19:56:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 19:56:48 [DEBUG   ] Finished updating board flags in 1.975 seconds
2014-02-26 19:57:06 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 19:57:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 19:57:35 [DEBUG   ] Got command RPT from MCS: ref #287036
2014-02-26 19:57:35 [DEBUG   ] summary = ERROR
2014-02-26 19:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287036  13 56714 71855537 A  ERRORERROR'
2014-02-26 19:57:35 [DEBUG   ] Got command RPT from MCS: ref #287037
2014-02-26 19:57:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 19:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287037  77 56714 71855538 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 19:57:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 19:57:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2014-02-26 19:57:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-02-26 19:57:48 [CRITICAL] MGT underflow detected on beam(s) 1
2014-02-26 19:57:48 [DEBUG   ] Finished updating board flags in 1.831 seconds
2014-02-26 19:58:06 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 19:58:26 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 19:58:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 19:58:48 [DEBUG   ] Finished updating board flags in 1.791 seconds
2014-02-26 19:59:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 19:59:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 19:59:46 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 19:59:48 [DEBUG   ] Finished updating board flags in 1.703 seconds
2014-02-26 20:00:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 20:00:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 20:00:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 20:00:48 [DEBUG   ] Finished updating board flags in 1.516 seconds
2014-02-26 20:01:06 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 20:01:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 20:01:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 20:01:48 [DEBUG   ] Finished updating board flags in 1.504 seconds
2014-02-26 20:02:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 20:02:26 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 20:02:35 [DEBUG   ] Got command RPT from MCS: ref #287053
2014-02-26 20:02:35 [DEBUG   ] summary = ERROR
2014-02-26 20:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287053  13 56714 72155549 A  ERRORERROR'
2014-02-26 20:02:35 [DEBUG   ] Got command RPT from MCS: ref #287054
2014-02-26 20:02:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 20:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287054  77 56714 72155550 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 20:02:46 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 20:02:48 [DEBUG   ] Finished updating board flags in 1.514 seconds
2014-02-26 20:03:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 20:03:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 20:03:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 20:03:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 20:03:49 [DEBUG   ] Finished updating board flags in 2.212 seconds
2014-02-26 20:04:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 20:04:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 20:04:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 20:04:49 [DEBUG   ] Finished updating board flags in 2.152 seconds
2014-02-26 20:05:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 20:05:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 20:05:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 20:05:49 [DEBUG   ] Finished updating board flags in 2.092 seconds
2014-02-26 20:06:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 20:06:26 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 20:06:46 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 20:06:49 [DEBUG   ] Finished updating board flags in 1.921 seconds
2014-02-26 20:07:07 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-02-26 20:07:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 20:07:35 [DEBUG   ] Got command RPT from MCS: ref #287070
2014-02-26 20:07:35 [DEBUG   ] summary = ERROR
2014-02-26 20:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287070  13 56714 72455545 A  ERRORERROR'
2014-02-26 20:07:35 [DEBUG   ] Got command RPT from MCS: ref #287071
2014-02-26 20:07:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 20:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287071  77 56714 72455546 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 20:07:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 20:07:49 [DEBUG   ] Finished updating board flags in 1.801 seconds
2014-02-26 20:08:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 20:08:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-26 20:08:47 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 20:08:49 [DEBUG   ] Finished updating board flags in 1.795 seconds
2014-02-26 20:09:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 20:09:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 20:09:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-26 20:09:49 [DEBUG   ] Finished updating board flags in 1.622 seconds
2014-02-26 20:10:07 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2014-02-26 20:10:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 20:10:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 20:10:49 [DEBUG   ] Finished updating board flags in 1.614 seconds
2014-02-26 20:11:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 20:11:27 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 20:11:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 20:11:49 [DEBUG   ] Finished updating board flags in 1.560 seconds
2014-02-26 20:12:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 20:12:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 20:12:35 [DEBUG   ] Got command RPT from MCS: ref #287087
2014-02-26 20:12:35 [DEBUG   ] summary = ERROR
2014-02-26 20:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287087  13 56714 72755549 A  ERRORERROR'
2014-02-26 20:12:35 [DEBUG   ] Got command RPT from MCS: ref #287088
2014-02-26 20:12:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 20:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287088  77 56714 72755550 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 20:12:47 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 20:12:49 [DEBUG   ] Finished updating board flags in 1.546 seconds
2014-02-26 20:13:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 20:13:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 20:13:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 20:13:49 [DEBUG   ] Finished updating board flags in 1.547 seconds
2014-02-26 20:14:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-26 20:14:27 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2014-02-26 20:14:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 20:14:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 20:14:50 [DEBUG   ] Finished updating board flags in 2.209 seconds
2014-02-26 20:15:07 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2014-02-26 20:15:27 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2014-02-26 20:15:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-26 20:15:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 20:15:50 [DEBUG   ] Finished updating board flags in 2.203 seconds
2014-02-26 20:16:07 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-26 20:16:27 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2014-02-26 20:16:47 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2014-02-26 20:16:50 [DEBUG   ] Finished updating board flags in 2.104 seconds
2014-02-26 20:17:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 20:17:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-26 20:17:35 [DEBUG   ] Got command RPT from MCS: ref #287104
2014-02-26 20:17:35 [DEBUG   ] summary = ERROR
2014-02-26 20:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287104  13 56714 73055549 A  ERRORERROR'
2014-02-26 20:17:35 [DEBUG   ] Got command RPT from MCS: ref #287105
2014-02-26 20:17:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 20:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287105  77 56714 73055550 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 20:17:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 20:17:50 [DEBUG   ] Finished updating board flags in 2.005 seconds
2014-02-26 20:18:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 20:18:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 20:18:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 20:18:50 [DEBUG   ] Finished updating board flags in 2.007 seconds
2014-02-26 20:19:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 20:19:28 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2014-02-26 20:19:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 20:19:50 [DEBUG   ] Finished updating board flags in 1.984 seconds
2014-02-26 20:20:08 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 20:20:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-26 20:20:48 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-26 20:20:50 [DEBUG   ] Finished updating board flags in 1.815 seconds
2014-02-26 20:21:08 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 20:21:28 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 20:21:48 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 20:21:50 [DEBUG   ] Finished updating board flags in 1.866 seconds
2014-02-26 20:22:08 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2014-02-26 20:22:29 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-02-26 20:22:35 [DEBUG   ] Got command RPT from MCS: ref #287121
2014-02-26 20:22:35 [DEBUG   ] summary = ERROR
2014-02-26 20:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287121  13 56714 73355545 A  ERRORERROR'
2014-02-26 20:22:35 [DEBUG   ] Got command RPT from MCS: ref #287122
2014-02-26 20:22:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 20:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287122  77 56714 73355546 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 20:22:49 [DEBUG   ] Finished updating ant stats in 1.255 seconds
2014-02-26 20:22:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 20:22:50 [DEBUG   ] Finished updating board flags in 1.808 seconds
2014-02-26 20:23:09 [DEBUG   ] Finished updating ant stats in 1.157 seconds
2014-02-26 20:23:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 20:23:49 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2014-02-26 20:23:50 [DEBUG   ] Finished updating board flags in 1.725 seconds
2014-02-26 20:24:09 [DEBUG   ] Finished updating ant stats in 0.956 seconds
2014-02-26 20:24:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 20:24:49 [DEBUG   ] Finished updating ant stats in 0.848 seconds
2014-02-26 20:24:50 [DEBUG   ] Finished updating board flags in 1.607 seconds
2014-02-26 20:25:09 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2014-02-26 20:25:30 [DEBUG   ] Finished updating ant stats in 1.605 seconds
2014-02-26 20:25:49 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2014-02-26 20:25:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 20:25:50 [DEBUG   ] Finished updating board flags in 1.584 seconds
2014-02-26 20:26:09 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2014-02-26 20:26:29 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2014-02-26 20:26:50 [DEBUG   ] Finished updating ant stats in 1.250 seconds
2014-02-26 20:26:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 20:26:50 [DEBUG   ] Finished updating board flags in 1.468 seconds
2014-02-26 20:27:10 [DEBUG   ] Finished updating ant stats in 1.157 seconds
2014-02-26 20:27:30 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 20:27:35 [DEBUG   ] Got command RPT from MCS: ref #287138
2014-02-26 20:27:35 [DEBUG   ] summary = ERROR
2014-02-26 20:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287138  13 56714 73655549 A  ERRORERROR'
2014-02-26 20:27:35 [DEBUG   ] Got command RPT from MCS: ref #287139
2014-02-26 20:27:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 20:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287139  77 56714 73655550 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 20:27:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 20:27:50 [DEBUG   ] Finished updating ant stats in 0.840 seconds
2014-02-26 20:27:50 [DEBUG   ] Finished updating board flags in 1.453 seconds
2014-02-26 20:28:10 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2014-02-26 20:28:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2014-02-26 20:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2014-02-26 20:28:50 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2014-02-26 20:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2014-02-26 20:28:50 [DEBUG   ] Finished updating board flags in 1.464 seconds
2014-02-26 20:29:10 [DEBUG   ] Finished updating ant stats in 0.557 seconds
2014-02-26 20:29:30 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-02-26 20:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-02-26 20:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-02-26 20:29:50 [DEBUG   ] Finished updating board flags in 1.505 seconds
2014-02-26 20:29:51 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-02-26 20:30:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 20:30:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 20:30:51 [DEBUG   ] Finished updating ant stats in 1.245 seconds
2014-02-26 20:30:51 [DEBUG   ] Finished updating board flags in 2.195 seconds
2014-02-26 20:31:11 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2014-02-26 20:31:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 20:31:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 20:31:51 [DEBUG   ] Finished updating ant stats in 1.044 seconds
2014-02-26 20:31:51 [DEBUG   ] Finished updating board flags in 1.983 seconds
2014-02-26 20:32:11 [DEBUG   ] Finished updating ant stats in 0.957 seconds
2014-02-26 20:32:31 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 20:32:35 [DEBUG   ] Got command RPT from MCS: ref #287155
2014-02-26 20:32:35 [DEBUG   ] summary = ERROR
2014-02-26 20:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287155  13 56714 73955557 A  ERRORERROR'
2014-02-26 20:32:35 [DEBUG   ] Got command RPT from MCS: ref #287156
2014-02-26 20:32:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 20:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287156  77 56714 73955558 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 20:32:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-26 20:32:51 [DEBUG   ] Finished updating ant stats in 0.650 seconds
2014-02-26 20:32:51 [DEBUG   ] Finished updating board flags in 1.829 seconds
2014-02-26 20:33:11 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2014-02-26 20:33:31 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2014-02-26 20:33:51 [DEBUG   ] Finished updating board flags in 1.778 seconds
2014-02-26 20:33:52 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-02-26 20:34:12 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2014-02-26 20:34:32 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-26 20:34:51 [DEBUG   ] Finished updating board flags in 1.616 seconds
2014-02-26 20:34:52 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 20:35:12 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-26 20:35:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 20:35:51 [DEBUG   ] Finished updating board flags in 1.579 seconds
2014-02-26 20:35:52 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-26 20:35:57 [DEBUG   ] Got command TBW from MCS: ref #287223
2014-02-26 20:35:57 [DEBUG   ] tbw = exited with status True, code 0x00
2014-02-26 20:35:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   287223   8 56714 74157594 A  ERROR'
2014-02-26 20:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2014-02-26 20:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2014-02-26 20:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2014-02-26 20:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2014-02-26 20:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2014-02-26 20:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2014-02-26 20:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2014-02-26 20:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2014-02-26 20:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2014-02-26 20:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2014-02-26 20:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2014-02-26 20:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2014-02-26 20:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2014-02-26 20:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2014-02-26 20:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2014-02-26 20:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2014-02-26 20:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2014-02-26 20:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2014-02-26 20:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2014-02-26 20:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2014-02-26 20:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2014-02-26 20:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2014-02-26 20:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2014-02-26 20:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2014-02-26 20:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2014-02-26 20:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2014-02-26 20:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2014-02-26 20:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2014-02-26 20:36:01 [DEBUG   ] spawn_process: at 2014-02-26 20:36:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2014-02-26 20:36:01 [DEBUG   ] spawn_process: at 2014-02-26 20:36:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2014-02-26 20:36:01 [DEBUG   ] spawn_process: at 2014-02-26 20:36:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2014-02-26 20:36:01 [DEBUG   ] spawn_process: at 2014-02-26 20:36:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2014-02-26 20:36:01 [DEBUG   ] spawn_process: at 2014-02-26 20:36:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2014-02-26 20:36:01 [DEBUG   ] spawn_process: at 2014-02-26 20:36:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2014-02-26 20:36:01 [DEBUG   ] spawn_process: at 2014-02-26 20:36:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2014-02-26 20:36:01 [DEBUG   ] spawn_process: at 2014-02-26 20:36:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2014-02-26 20:36:01 [DEBUG   ] spawn_process: at 2014-02-26 20:36:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2014-02-26 20:36:01 [DEBUG   ] spawn_process: at 2014-02-26 20:36:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2014-02-26 20:36:01 [DEBUG   ] spawn_process: at 2014-02-26 20:36:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2014-02-26 20:36:01 [DEBUG   ] spawn_process: at 2014-02-26 20:36:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2014-02-26 20:36:01 [DEBUG   ] spawn_process: at 2014-02-26 20:36:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2014-02-26 20:36:01 [DEBUG   ] spawn_process: at 2014-02-26 20:36:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2014-02-26 20:36:01 [DEBUG   ] spawn_process: at 2014-02-26 20:36:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2014-02-26 20:36:01 [DEBUG   ] spawn_process: at 2014-02-26 20:36:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2014-02-26 20:36:01 [DEBUG   ] spawn_process: at 2014-02-26 20:36:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2014-02-26 20:36:01 [DEBUG   ] spawn_process: at 2014-02-26 20:36:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2014-02-26 20:36:01 [DEBUG   ] spawn_process: at 2014-02-26 20:36:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2014-02-26 20:36:01 [DEBUG   ] spawn_process: at 2014-02-26 20:36:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2014-02-26 20:36:01 [DEBUG   ] spawn_process: at 2014-02-26 20:36:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2014-02-26 20:36:01 [DEBUG   ] spawn_process: at 2014-02-26 20:36:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2014-02-26 20:36:01 [DEBUG   ] spawn_process: at 2014-02-26 20:36:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2014-02-26 20:36:01 [DEBUG   ] spawn_process: at 2014-02-26 20:36:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2014-02-26 20:36:01 [DEBUG   ] spawn_process: at 2014-02-26 20:36:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2014-02-26 20:36:01 [DEBUG   ] spawn_process: at 2014-02-26 20:36:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2014-02-26 20:36:01 [INFO    ] Finished spawning TBW
2014-02-26 20:36:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2014-02-26 20:36:51 [DEBUG   ] Finished updating board flags in 1.267 seconds
2014-02-26 20:37:35 [DEBUG   ] Got command RPT from MCS: ref #287228
2014-02-26 20:37:35 [DEBUG   ] summary = ERROR
2014-02-26 20:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287228  13 56714 74255558 A  ERRORERROR'
2014-02-26 20:37:35 [DEBUG   ] Got command RPT from MCS: ref #287229
2014-02-26 20:37:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 20:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287229  77 56714 74255558 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 20:37:51 [DEBUG   ] Finished updating board flags in 1.142 seconds
2014-02-26 20:38:52 [DEBUG   ] Finished updating board flags in 2.084 seconds
2014-02-26 20:39:40 [INFO    ] __waitForTBW - TBW finished in 218.933 s
2014-02-26 20:39:41 [INFO    ] Started antennas statistics background thread
2014-02-26 20:39:41 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2014-02-26 20:39:41 [DEBUG   ] spawn_process: at 2014-02-26 20:39:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '1', '1393447182']
2014-02-26 20:39:41 [DEBUG   ] spawn_process: at 2014-02-26 20:39:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '2', '1393447182']
2014-02-26 20:39:41 [DEBUG   ] spawn_process: at 2014-02-26 20:39:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '3', '1393447182']
2014-02-26 20:39:41 [DEBUG   ] spawn_process: at 2014-02-26 20:39:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '4', '1393447182']
2014-02-26 20:39:41 [DEBUG   ] spawn_process: at 2014-02-26 20:39:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '5', '1393447182']
2014-02-26 20:39:41 [DEBUG   ] spawn_process: at 2014-02-26 20:39:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '6', '1393447182']
2014-02-26 20:39:41 [DEBUG   ] spawn_process: at 2014-02-26 20:39:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '7', '1393447182']
2014-02-26 20:39:41 [DEBUG   ] spawn_process: at 2014-02-26 20:39:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '8', '1393447182']
2014-02-26 20:39:41 [DEBUG   ] spawn_process: at 2014-02-26 20:39:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '9', '1393447182']
2014-02-26 20:39:41 [DEBUG   ] spawn_process: at 2014-02-26 20:39:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '10', '1393447182']
2014-02-26 20:39:41 [DEBUG   ] spawn_process: at 2014-02-26 20:39:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '11', '1393447182']
2014-02-26 20:39:41 [DEBUG   ] spawn_process: at 2014-02-26 20:39:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '12', '1393447182']
2014-02-26 20:39:41 [DEBUG   ] spawn_process: at 2014-02-26 20:39:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '13', '1393447182']
2014-02-26 20:39:41 [DEBUG   ] spawn_process: at 2014-02-26 20:39:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '14', '1393447182']
2014-02-26 20:39:41 [DEBUG   ] spawn_process: at 2014-02-26 20:39:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '15', '1393447182']
2014-02-26 20:39:41 [DEBUG   ] spawn_process: at 2014-02-26 20:39:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '16', '1393447182']
2014-02-26 20:39:41 [DEBUG   ] spawn_process: at 2014-02-26 20:39:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '17', '1393447182']
2014-02-26 20:39:41 [DEBUG   ] spawn_process: at 2014-02-26 20:39:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '18', '1393447182']
2014-02-26 20:39:41 [DEBUG   ] spawn_process: at 2014-02-26 20:39:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '19', '1393447182']
2014-02-26 20:39:41 [DEBUG   ] spawn_process: at 2014-02-26 20:39:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '20', '1393447182']
2014-02-26 20:39:41 [DEBUG   ] spawn_process: at 2014-02-26 20:39:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '21', '1393447182']
2014-02-26 20:39:41 [DEBUG   ] spawn_process: at 2014-02-26 20:39:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '22', '1393447182']
2014-02-26 20:39:41 [DEBUG   ] spawn_process: at 2014-02-26 20:39:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '23', '1393447182']
2014-02-26 20:39:41 [DEBUG   ] spawn_process: at 2014-02-26 20:39:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '24', '1393447182']
2014-02-26 20:39:41 [DEBUG   ] spawn_process: at 2014-02-26 20:39:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '25', '1393447182']
2014-02-26 20:39:41 [DEBUG   ] spawn_process: at 2014-02-26 20:39:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '26', '1393447182']
2014-02-26 20:39:41 [INFO    ] Finished spawning TBN in 0.053 s
2014-02-26 20:39:41 [DEBUG   ] Finished updating ant stats in 1.273 seconds
2014-02-26 20:39:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 20:39:52 [DEBUG   ] Finished updating board flags in 2.216 seconds
2014-02-26 20:40:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 20:40:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 20:40:41 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-26 20:40:52 [DEBUG   ] Finished updating board flags in 2.059 seconds
2014-02-26 20:41:01 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 20:41:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 20:41:41 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-26 20:41:52 [DEBUG   ] Finished updating board flags in 2.018 seconds
2014-02-26 20:42:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 20:42:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 20:42:35 [DEBUG   ] Got command RPT from MCS: ref #287255
2014-02-26 20:42:35 [DEBUG   ] summary = ERROR
2014-02-26 20:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287255  13 56714 74555553 A  ERRORERROR'
2014-02-26 20:42:35 [DEBUG   ] Got command RPT from MCS: ref #287256
2014-02-26 20:42:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 20:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287256  77 56714 74555554 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 20:42:41 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-26 20:42:52 [DEBUG   ] Finished updating board flags in 1.973 seconds
2014-02-26 20:43:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 20:43:21 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 20:43:41 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 20:43:52 [DEBUG   ] Finished updating board flags in 1.819 seconds
2014-02-26 20:44:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 20:44:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 20:44:41 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 20:44:52 [DEBUG   ] Finished updating board flags in 1.796 seconds
2014-02-26 20:45:01 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2014-02-26 20:45:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 20:45:41 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 20:45:52 [DEBUG   ] Finished updating board flags in 1.611 seconds
2014-02-26 20:46:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 20:46:21 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2014-02-26 20:46:42 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2014-02-26 20:46:52 [DEBUG   ] Finished updating board flags in 1.585 seconds
2014-02-26 20:47:01 [DEBUG   ] Finished updating ant stats in 0.407 seconds
2014-02-26 20:47:22 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-02-26 20:47:35 [DEBUG   ] Got command RPT from MCS: ref #287307
2014-02-26 20:47:35 [DEBUG   ] summary = ERROR
2014-02-26 20:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287307  13 56714 74855557 A  ERRORERROR'
2014-02-26 20:47:35 [DEBUG   ] Got command RPT from MCS: ref #287308
2014-02-26 20:47:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 20:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287308  77 56714 74855558 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 20:47:42 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2014-02-26 20:47:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 20:47:52 [DEBUG   ] Finished updating board flags in 1.419 seconds
2014-02-26 20:48:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 20:48:22 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 20:48:42 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 20:48:52 [DEBUG   ] Finished updating board flags in 1.383 seconds
2014-02-26 20:49:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 20:49:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 20:49:42 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-26 20:49:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-26 20:49:52 [DEBUG   ] Finished updating board flags in 1.348 seconds
2014-02-26 20:50:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 20:50:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 20:50:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 20:50:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 20:50:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 20:50:53 [DEBUG   ] Finished updating board flags in 2.080 seconds
2014-02-26 20:51:02 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 20:51:22 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 20:51:43 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-02-26 20:51:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 20:51:53 [DEBUG   ] Finished updating board flags in 1.984 seconds
2014-02-26 20:52:03 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 20:52:23 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 20:52:35 [DEBUG   ] Got command RPT from MCS: ref #287324
2014-02-26 20:52:35 [DEBUG   ] summary = ERROR
2014-02-26 20:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287324  13 56714 75155561 A  ERRORERROR'
2014-02-26 20:52:35 [DEBUG   ] Got command RPT from MCS: ref #287325
2014-02-26 20:52:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 20:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287325  77 56714 75155562 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 20:52:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 20:52:53 [DEBUG   ] Finished updating board flags in 1.811 seconds
2014-02-26 20:53:03 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 20:53:23 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 20:53:43 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2014-02-26 20:53:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-26 20:53:53 [DEBUG   ] Finished updating board flags in 1.810 seconds
2014-02-26 20:54:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 20:54:23 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 20:54:43 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2014-02-26 20:54:53 [DEBUG   ] Finished updating board flags in 1.783 seconds
2014-02-26 20:55:03 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-26 20:55:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 20:55:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 20:55:53 [DEBUG   ] Finished updating board flags in 1.624 seconds
2014-02-26 20:56:03 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 20:56:23 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-26 20:56:44 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-02-26 20:56:53 [DEBUG   ] Finished updating board flags in 1.589 seconds
2014-02-26 20:57:03 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-02-26 20:57:24 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-02-26 20:57:35 [DEBUG   ] Got command RPT from MCS: ref #287341
2014-02-26 20:57:35 [DEBUG   ] summary = ERROR
2014-02-26 20:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287341  13 56714 75455553 A  ERRORERROR'
2014-02-26 20:57:35 [DEBUG   ] Got command RPT from MCS: ref #287342
2014-02-26 20:57:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 20:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287342  77 56714 75455554 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 20:57:44 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-26 20:57:53 [DEBUG   ] Finished updating board flags in 1.412 seconds
2014-02-26 20:58:04 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 20:58:24 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 20:58:44 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2014-02-26 20:58:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 20:58:53 [DEBUG   ] Finished updating board flags in 1.383 seconds
2014-02-26 20:59:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 20:59:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 20:59:44 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 20:59:53 [DEBUG   ] Finished updating board flags in 1.379 seconds
2014-02-26 21:00:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 21:00:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 21:00:44 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 21:00:54 [DEBUG   ] Finished updating board flags in 2.039 seconds
2014-02-26 21:01:04 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-26 21:01:24 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-26 21:01:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 21:01:54 [DEBUG   ] Finished updating board flags in 1.986 seconds
2014-02-26 21:02:04 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 21:02:24 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-26 21:02:35 [DEBUG   ] Got command RPT from MCS: ref #287358
2014-02-26 21:02:35 [DEBUG   ] summary = ERROR
2014-02-26 21:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287358  13 56714 75755557 A  ERRORERROR'
2014-02-26 21:02:35 [DEBUG   ] Got command RPT from MCS: ref #287359
2014-02-26 21:02:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 21:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287359  77 56714 75755558 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 21:02:45 [DEBUG   ] Finished updating ant stats in 1.406 seconds
2014-02-26 21:02:54 [DEBUG   ] Finished updating board flags in 1.816 seconds
2014-02-26 21:03:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-26 21:03:25 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-26 21:03:45 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-26 21:03:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2014-02-26 21:03:54 [CRITICAL] MGT underflow detected on beam(s) 1
2014-02-26 21:03:54 [DEBUG   ] Finished updating board flags in 1.805 seconds
2014-02-26 21:04:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-26 21:04:25 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 21:04:45 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 21:04:54 [DEBUG   ] Finished updating board flags in 1.815 seconds
2014-02-26 21:05:05 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2014-02-26 21:05:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 21:05:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 21:05:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-26 21:05:54 [DEBUG   ] Finished updating board flags in 1.811 seconds
2014-02-26 21:06:05 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 21:06:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 21:06:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 21:06:54 [DEBUG   ] Finished updating board flags in 1.869 seconds
2014-02-26 21:07:05 [DEBUG   ] Finished updating ant stats in 0.993 seconds
2014-02-26 21:07:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 21:07:35 [DEBUG   ] Got command RPT from MCS: ref #287375
2014-02-26 21:07:35 [DEBUG   ] summary = ERROR
2014-02-26 21:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287375  13 56714 76055565 A  ERRORERROR'
2014-02-26 21:07:35 [DEBUG   ] Got command RPT from MCS: ref #287376
2014-02-26 21:07:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 21:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287376  77 56714 76055566 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 21:07:45 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 21:07:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-26 21:07:54 [DEBUG   ] Finished updating board flags in 1.707 seconds
2014-02-26 21:08:06 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-02-26 21:08:26 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-26 21:08:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-26 21:08:54 [DEBUG   ] Finished updating board flags in 1.602 seconds
2014-02-26 21:09:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 21:09:26 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 21:09:46 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 21:09:54 [DEBUG   ] Finished updating board flags in 1.618 seconds
2014-02-26 21:10:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 21:10:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 21:10:46 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 21:10:54 [DEBUG   ] Finished updating board flags in 1.588 seconds
2014-02-26 21:11:06 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-26 21:11:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 21:11:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 21:11:54 [DEBUG   ] Finished updating board flags in 1.421 seconds
2014-02-26 21:12:06 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 21:12:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-26 21:12:35 [DEBUG   ] Got command RPT from MCS: ref #287392
2014-02-26 21:12:35 [DEBUG   ] summary = ERROR
2014-02-26 21:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287392  13 56714 76355565 A  ERRORERROR'
2014-02-26 21:12:35 [DEBUG   ] Got command RPT from MCS: ref #287393
2014-02-26 21:12:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 21:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287393  77 56714 76355566 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 21:12:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 21:12:54 [DEBUG   ] Finished updating board flags in 1.367 seconds
2014-02-26 21:13:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 21:13:26 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2014-02-26 21:13:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 21:13:54 [DEBUG   ] Finished updating board flags in 1.371 seconds
2014-02-26 21:14:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 21:14:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 21:14:46 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 21:14:55 [DEBUG   ] Finished updating board flags in 2.062 seconds
2014-02-26 21:15:06 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-02-26 21:15:27 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-02-26 21:15:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 196000019
2014-02-26 21:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 196000019
2014-02-26 21:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 196000019
2014-02-26 21:15:55 [DEBUG   ] Finished updating board flags in 1.991 seconds
2014-02-26 21:16:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 21:16:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 21:16:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-02-26 21:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-02-26 21:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-02-26 21:16:55 [DEBUG   ] Finished updating board flags in 1.811 seconds
2014-02-26 21:17:07 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 21:17:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 21:17:35 [DEBUG   ] Got command RPT from MCS: ref #287409
2014-02-26 21:17:35 [DEBUG   ] summary = ERROR
2014-02-26 21:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287409  13 56714 76655561 A  ERRORERROR'
2014-02-26 21:17:35 [DEBUG   ] Got command RPT from MCS: ref #287410
2014-02-26 21:17:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 21:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287410  77 56714 76655562 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 21:17:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 21:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:17:55 [DEBUG   ] Finished updating board flags in 1.781 seconds
2014-02-26 21:18:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 21:18:27 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 21:18:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 21:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:18:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:18:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:18:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:18:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:18:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:18:55 [DEBUG   ] Finished updating board flags in 1.611 seconds
2014-02-26 21:19:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 21:19:27 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 21:19:47 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-26 21:19:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:19:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:19:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:19:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:19:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:19:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:19:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:19:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:19:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:19:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:19:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 21:19:55 [DEBUG   ] Finished updating board flags in 1.672 seconds
2014-02-26 21:20:08 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-02-26 21:20:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-26 21:20:48 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 21:20:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:20:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:20:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:20:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:20:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:20:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:20:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:20:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:20:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:20:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:20:55 [DEBUG   ] Finished updating board flags in 1.521 seconds
2014-02-26 21:21:08 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 21:21:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 21:21:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-26 21:21:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:21:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:21:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:21:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:21:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:21:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:21:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:21:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:21:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:21:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:21:55 [DEBUG   ] Finished updating board flags in 1.480 seconds
2014-02-26 21:22:08 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 21:22:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 21:22:35 [DEBUG   ] Got command RPT from MCS: ref #287426
2014-02-26 21:22:35 [DEBUG   ] summary = ERROR
2014-02-26 21:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287426  13 56714 76955565 A  ERRORERROR'
2014-02-26 21:22:35 [DEBUG   ] Got command RPT from MCS: ref #287427
2014-02-26 21:22:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 21:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287427  77 56714 76955566 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 21:22:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 21:22:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:22:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:22:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:22:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:22:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:22:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:22:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:22:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:22:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:22:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:22:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 21:22:55 [DEBUG   ] Finished updating board flags in 1.478 seconds
2014-02-26 21:23:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 21:23:28 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-26 21:23:48 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-26 21:23:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:23:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:23:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:23:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:23:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:23:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:23:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:23:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:23:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:23:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:23:55 [DEBUG   ] Finished updating board flags in 1.481 seconds
2014-02-26 21:24:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 21:24:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 21:24:48 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 21:24:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:24:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:24:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:24:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:24:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:24:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:24:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:24:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:24:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:24:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:24:56 [DEBUG   ] Finished updating board flags in 2.272 seconds
2014-02-26 21:25:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 21:25:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 21:25:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 21:25:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:25:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:25:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:25:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:25:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:25:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:25:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:25:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:25:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:25:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:25:56 [DEBUG   ] Finished updating board flags in 2.105 seconds
2014-02-26 21:26:08 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-26 21:26:28 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2014-02-26 21:26:49 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-02-26 21:26:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:26:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:26:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:26:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:26:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:26:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:26:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:26:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:26:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:26:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:26:56 [DEBUG   ] Finished updating board flags in 2.011 seconds
2014-02-26 21:27:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 21:27:29 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-26 21:27:35 [DEBUG   ] Got command RPT from MCS: ref #287443
2014-02-26 21:27:35 [DEBUG   ] summary = ERROR
2014-02-26 21:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287443  13 56714 77255561 A  ERRORERROR'
2014-02-26 21:27:35 [DEBUG   ] Got command RPT from MCS: ref #287444
2014-02-26 21:27:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 21:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287444  77 56714 77255562 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 21:27:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 21:27:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:27:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:27:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:27:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:27:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:27:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:27:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:27:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:27:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:27:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:27:56 [DEBUG   ] Finished updating board flags in 1.983 seconds
2014-02-26 21:28:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-26 21:28:29 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 21:28:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 21:28:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:28:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:28:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:28:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:28:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:28:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:28:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:28:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:28:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:28:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:28:56 [DEBUG   ] Finished updating board flags in 1.821 seconds
2014-02-26 21:29:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 21:29:29 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 21:29:49 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-26 21:29:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:29:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:29:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:29:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:29:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:29:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:29:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:29:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:29:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:29:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:29:56 [DEBUG   ] Finished updating board flags in 1.791 seconds
2014-02-26 21:30:09 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-26 21:30:29 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-02-26 21:30:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 21:30:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:30:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:30:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:30:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:30:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:30:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:30:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:30:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:30:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:30:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:30:56 [DEBUG   ] Finished updating board flags in 1.621 seconds
2014-02-26 21:31:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 21:31:29 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-26 21:31:50 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-02-26 21:31:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:31:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:31:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:31:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:31:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:31:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:31:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:31:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:31:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:31:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:31:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 21:31:56 [DEBUG   ] Finished updating board flags in 1.578 seconds
2014-02-26 21:32:10 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 21:32:30 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-26 21:32:35 [DEBUG   ] Got command RPT from MCS: ref #287460
2014-02-26 21:32:35 [DEBUG   ] summary = ERROR
2014-02-26 21:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287460  13 56714 77555565 A  ERRORERROR'
2014-02-26 21:32:35 [DEBUG   ] Got command RPT from MCS: ref #287461
2014-02-26 21:32:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 21:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287461  77 56714 77555566 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 21:32:50 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-26 21:32:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:32:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:32:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:32:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:32:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:32:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:32:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:32:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:32:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:32:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:32:56 [DEBUG   ] Finished updating board flags in 1.414 seconds
2014-02-26 21:33:10 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 21:33:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 21:33:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 21:33:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:33:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:33:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:33:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:33:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:33:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:33:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:33:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:33:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:33:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:33:56 [DEBUG   ] Finished updating board flags in 1.390 seconds
2014-02-26 21:34:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 21:34:30 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-26 21:34:50 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 21:34:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:34:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:34:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:34:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:34:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:34:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:34:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:34:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:34:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:34:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:34:56 [DEBUG   ] Finished updating board flags in 1.355 seconds
2014-02-26 21:35:10 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-02-26 21:35:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 21:35:50 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-26 21:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:35:57 [DEBUG   ] Finished updating board flags in 2.057 seconds
2014-02-26 21:36:11 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-02-26 21:36:30 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2014-02-26 21:36:51 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-02-26 21:36:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:36:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:36:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:36:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:36:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:36:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 21:36:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2014-02-26 21:36:57 [DEBUG   ] Finished updating board flags in 2.001 seconds
2014-02-26 21:37:11 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-26 21:37:31 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-26 21:37:35 [DEBUG   ] Got command RPT from MCS: ref #287477
2014-02-26 21:37:35 [DEBUG   ] summary = ERROR
2014-02-26 21:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287477  13 56714 77855561 A  ERRORERROR'
2014-02-26 21:37:35 [DEBUG   ] Got command RPT from MCS: ref #287478
2014-02-26 21:37:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 21:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287478  77 56714 77855562 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 21:37:51 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 21:37:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:37:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:37:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:37:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:37:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:37:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:37:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:37:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:37:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:37:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:37:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-02-26 21:37:57 [DEBUG   ] Finished updating board flags in 2.000 seconds
2014-02-26 21:38:11 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2014-02-26 21:38:31 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-26 21:38:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 21:38:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:38:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:38:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:38:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:38:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:38:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:38:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:38:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:38:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:38:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:38:57 [DEBUG   ] Finished updating board flags in 1.997 seconds
2014-02-26 21:39:11 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 21:39:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 21:39:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 21:39:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:39:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:39:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:39:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:39:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:39:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:39:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:39:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:39:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:39:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:39:57 [DEBUG   ] Finished updating board flags in 1.810 seconds
2014-02-26 21:40:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 21:40:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 21:40:51 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-26 21:40:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:40:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:40:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:40:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:40:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:40:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:40:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:40:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:40:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:40:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:40:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 21:40:57 [DEBUG   ] Finished updating board flags in 1.821 seconds
2014-02-26 21:41:11 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2014-02-26 21:41:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 21:41:51 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2014-02-26 21:41:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:41:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:41:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:41:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:41:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:41:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:41:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:41:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:41:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:41:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:41:57 [DEBUG   ] Finished updating board flags in 1.771 seconds
2014-02-26 21:42:11 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-26 21:42:32 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-02-26 21:42:35 [DEBUG   ] Got command RPT from MCS: ref #287494
2014-02-26 21:42:35 [DEBUG   ] summary = ERROR
2014-02-26 21:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287494  13 56714 78155569 A  ERRORERROR'
2014-02-26 21:42:35 [DEBUG   ] Got command RPT from MCS: ref #287495
2014-02-26 21:42:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 21:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287495  77 56714 78155570 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 21:42:51 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2014-02-26 21:42:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:42:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:42:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:42:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:42:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:42:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:42:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:42:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:42:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:42:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:42:57 [DEBUG   ] Finished updating board flags in 1.617 seconds
2014-02-26 21:43:12 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-02-26 21:43:32 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2014-02-26 21:43:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 21:43:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:43:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:43:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:43:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:43:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:43:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:43:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:43:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:43:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:43:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:43:57 [DEBUG   ] Finished updating board flags in 1.585 seconds
2014-02-26 21:44:12 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-26 21:44:32 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 21:44:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 21:44:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:44:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:44:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:44:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:44:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:44:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:44:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:44:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:44:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:44:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:44:57 [DEBUG   ] Finished updating board flags in 1.414 seconds
2014-02-26 21:45:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 21:45:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 21:45:52 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-26 21:45:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:45:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:45:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:45:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:45:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:45:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:45:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:45:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:45:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:45:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:45:57 [DEBUG   ] Finished updating board flags in 1.424 seconds
2014-02-26 21:46:12 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-26 21:46:32 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-26 21:46:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 21:46:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:46:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:46:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:46:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:46:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:46:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:46:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:46:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:46:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:46:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:46:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 21:46:57 [DEBUG   ] Finished updating board flags in 1.418 seconds
2014-02-26 21:47:12 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2014-02-26 21:47:33 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-02-26 21:47:35 [DEBUG   ] Got command RPT from MCS: ref #287511
2014-02-26 21:47:35 [DEBUG   ] summary = ERROR
2014-02-26 21:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287511  13 56714 78455565 A  ERRORERROR'
2014-02-26 21:47:35 [DEBUG   ] Got command RPT from MCS: ref #287512
2014-02-26 21:47:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 21:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287512  77 56714 78455566 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 21:47:52 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2014-02-26 21:47:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:47:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:47:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:47:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:47:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:47:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:47:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:47:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:47:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:47:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:47:57 [DEBUG   ] Finished updating board flags in 1.417 seconds
2014-02-26 21:48:13 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-02-26 21:48:33 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-26 21:48:53 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-26 21:48:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:48:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:48:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:48:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:48:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:48:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:48:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:48:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:48:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:48:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:48:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 21:48:57 [DEBUG   ] Finished updating board flags in 1.418 seconds
2014-02-26 21:49:13 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 21:49:33 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 21:49:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 21:49:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:49:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:49:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:49:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:49:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:49:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:49:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:49:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:49:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:49:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:49:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2014-02-26 21:49:57 [CRITICAL] MGT underflow detected on beam(s) 1
2014-02-26 21:49:57 [DEBUG   ] Finished updating board flags in 1.415 seconds
2014-02-26 21:50:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 21:50:33 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 21:50:53 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-26 21:50:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:50:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:50:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:50:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:50:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:50:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:50:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:50:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:50:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:50:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:50:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 21:50:57 [DEBUG   ] Finished updating board flags in 1.418 seconds
2014-02-26 21:51:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-26 21:51:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 21:51:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 21:51:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:51:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:51:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:51:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:51:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:51:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:51:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:51:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:51:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:51:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:51:57 [DEBUG   ] Finished updating board flags in 1.424 seconds
2014-02-26 21:52:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-26 21:52:33 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2014-02-26 21:52:35 [DEBUG   ] Got command RPT from MCS: ref #287528
2014-02-26 21:52:35 [DEBUG   ] summary = ERROR
2014-02-26 21:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287528  13 56714 78755577 A  ERRORERROR'
2014-02-26 21:52:35 [DEBUG   ] Got command RPT from MCS: ref #287529
2014-02-26 21:52:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 21:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287529  77 56714 78755578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 21:52:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 21:52:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:52:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:52:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:52:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:52:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:52:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:52:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:52:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:52:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:52:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:52:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 21:52:57 [DEBUG   ] Finished updating board flags in 1.419 seconds
2014-02-26 21:53:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 21:53:33 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-26 21:53:54 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-02-26 21:53:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:53:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:53:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:53:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:53:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:53:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:53:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:53:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:53:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:53:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:53:57 [DEBUG   ] Finished updating board flags in 1.422 seconds
2014-02-26 21:54:14 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-02-26 21:54:34 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-26 21:54:54 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-26 21:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:54:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:54:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:54:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:54:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:54:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:54:57 [DEBUG   ] Finished updating board flags in 1.418 seconds
2014-02-26 21:55:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 21:55:34 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 21:55:54 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 21:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:55:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:55:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:55:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:55:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:55:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:55:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-26 21:55:57 [DEBUG   ] Finished updating board flags in 1.413 seconds
2014-02-26 21:56:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 21:56:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 21:56:54 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-26 21:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:56:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:56:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:56:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:56:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:56:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:56:57 [DEBUG   ] Finished updating board flags in 1.418 seconds
2014-02-26 21:57:14 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 21:57:35 [DEBUG   ] Finished updating ant stats in 1.598 seconds
2014-02-26 21:57:35 [DEBUG   ] Got command RPT from MCS: ref #287545
2014-02-26 21:57:35 [DEBUG   ] summary = ERROR
2014-02-26 21:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287545  13 56714 79055577 A  ERRORERROR'
2014-02-26 21:57:35 [DEBUG   ] Got command RPT from MCS: ref #287546
2014-02-26 21:57:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 21:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287546  77 56714 79055578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 21:57:55 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-02-26 21:57:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:57:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:57:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:57:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:57:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:57:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:57:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:57:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:57:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:57:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:57:58 [DEBUG   ] Finished updating board flags in 2.224 seconds
2014-02-26 21:58:15 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2014-02-26 21:58:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 21:58:55 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 21:58:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:58:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:58:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:58:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:58:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:58:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:58:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:58:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:58:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:58:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:58:58 [DEBUG   ] Finished updating board flags in 2.173 seconds
2014-02-26 21:59:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 21:59:35 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-26 21:59:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 21:59:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 21:59:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 21:59:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 21:59:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 21:59:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 21:59:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 21:59:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 21:59:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 21:59:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 21:59:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 21:59:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 21:59:58 [DEBUG   ] Finished updating board flags in 2.011 seconds
2014-02-26 22:00:15 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2014-02-26 22:00:35 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 22:00:55 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-26 22:00:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:00:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:00:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:00:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:00:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:00:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:00:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:00:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:00:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:00:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:00:58 [DEBUG   ] Finished updating board flags in 1.990 seconds
2014-02-26 22:01:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 22:01:35 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 22:01:55 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-26 22:01:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:01:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:01:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:01:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:01:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:01:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:01:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:01:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:01:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:01:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:01:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 22:01:58 [DEBUG   ] Finished updating board flags in 1.831 seconds
2014-02-26 22:02:16 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-02-26 22:02:35 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2014-02-26 22:02:35 [DEBUG   ] Got command RPT from MCS: ref #287562
2014-02-26 22:02:35 [DEBUG   ] summary = ERROR
2014-02-26 22:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287562  13 56714 79355573 A  ERRORERROR'
2014-02-26 22:02:35 [DEBUG   ] Got command RPT from MCS: ref #287563
2014-02-26 22:02:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 22:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287563  77 56714 79355574 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 22:02:56 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-02-26 22:02:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:02:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:02:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:02:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:02:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:02:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:02:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:02:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:02:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:02:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:02:58 [DEBUG   ] Finished updating board flags in 1.774 seconds
2014-02-26 22:03:16 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2014-02-26 22:03:36 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-26 22:03:56 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 22:03:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:03:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:03:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:03:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:03:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:03:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:03:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:03:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:03:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:03:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:03:58 [DEBUG   ] Finished updating board flags in 1.615 seconds
2014-02-26 22:04:16 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 22:04:36 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-26 22:04:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 22:04:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:04:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:04:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:04:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:04:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:04:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:04:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:04:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:04:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:04:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:04:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 22:04:58 [DEBUG   ] Finished updating board flags in 1.597 seconds
2014-02-26 22:05:16 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2014-02-26 22:05:36 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-26 22:05:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 22:05:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:05:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:05:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:05:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:05:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:05:58 [DEBUG   ] Finished updating board flags in 1.399 seconds
2014-02-26 22:06:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 22:06:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 22:06:56 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-26 22:06:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:06:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:06:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:06:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:06:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:06:58 [DEBUG   ] Finished updating board flags in 1.368 seconds
2014-02-26 22:07:17 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-02-26 22:07:35 [DEBUG   ] Got command RPT from MCS: ref #287579
2014-02-26 22:07:35 [DEBUG   ] summary = ERROR
2014-02-26 22:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287579  13 56714 79655578 A  ERRORERROR'
2014-02-26 22:07:35 [DEBUG   ] Got command RPT from MCS: ref #287580
2014-02-26 22:07:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 22:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287580  77 56714 79655578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 22:07:36 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2014-02-26 22:07:57 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-02-26 22:07:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:07:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:07:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:07:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:07:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:07:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:07:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:07:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:07:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:07:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:07:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 22:07:59 [DEBUG   ] Finished updating board flags in 2.053 seconds
2014-02-26 22:08:17 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-26 22:08:37 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-26 22:08:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-26 22:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:08:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-26 22:08:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:08:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:08:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:08:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:08:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:08:59 [DEBUG   ] Finished updating board flags in 1.981 seconds
2014-02-26 22:09:17 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 22:09:37 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-26 22:09:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 22:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:09:59 [DEBUG   ] Finished updating board flags in 1.816 seconds
2014-02-26 22:10:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 22:10:37 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-26 22:10:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 22:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:10:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:10:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:10:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:10:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:10:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:10:59 [DEBUG   ] Finished updating board flags in 1.798 seconds
2014-02-26 22:11:17 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-26 22:11:37 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 22:11:57 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-02-26 22:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:11:59 [DEBUG   ] Finished updating board flags in 1.603 seconds
2014-02-26 22:12:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 22:12:35 [DEBUG   ] Got command RPT from MCS: ref #287596
2014-02-26 22:12:35 [DEBUG   ] summary = ERROR
2014-02-26 22:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287596  13 56714 79955578 A  ERRORERROR'
2014-02-26 22:12:35 [DEBUG   ] Got command RPT from MCS: ref #287597
2014-02-26 22:12:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 22:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287597  77 56714 79955578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 22:12:37 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-26 22:12:57 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 22:12:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:12:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:12:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:12:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:12:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:12:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:12:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:12:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:12:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:12:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:12:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 22:12:59 [DEBUG   ] Finished updating board flags in 1.588 seconds
2014-02-26 22:13:17 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-26 22:13:37 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-26 22:13:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:13:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:13:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:13:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:13:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:13:58 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-02-26 22:13:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:13:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:13:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:13:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:13:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:13:59 [DEBUG   ] Finished updating board flags in 1.454 seconds
2014-02-26 22:14:18 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-26 22:14:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-26 22:14:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 22:14:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:14:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:14:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:14:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:14:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:14:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:14:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:14:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:14:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:14:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:14:59 [DEBUG   ] Finished updating board flags in 1.363 seconds
2014-02-26 22:15:18 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-02-26 22:15:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 22:15:58 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-26 22:15:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:15:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:15:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:15:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:15:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:16:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:16:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:16:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:16:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:16:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:16:00 [DEBUG   ] Finished updating board flags in 2.211 seconds
2014-02-26 22:16:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 22:16:38 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-26 22:16:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-26 22:16:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:16:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:16:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:16:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:16:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:17:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:17:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:17:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:17:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:17:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:17:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 22:17:00 [DEBUG   ] Finished updating board flags in 2.187 seconds
2014-02-26 22:17:18 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2014-02-26 22:17:35 [DEBUG   ] Got command RPT from MCS: ref #287613
2014-02-26 22:17:35 [DEBUG   ] summary = ERROR
2014-02-26 22:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287613  13 56714 80255578 A  ERRORERROR'
2014-02-26 22:17:35 [DEBUG   ] Got command RPT from MCS: ref #287614
2014-02-26 22:17:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 22:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287614  77 56714 80255578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 22:17:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 22:17:58 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-02-26 22:17:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:17:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:17:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:17:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:17:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:18:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:18:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:18:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:18:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:18:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:18:00 [DEBUG   ] Finished updating board flags in 2.013 seconds
2014-02-26 22:18:19 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-02-26 22:18:38 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2014-02-26 22:18:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:18:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:18:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:18:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:18:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:18:59 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-02-26 22:19:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:19:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:19:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:19:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:19:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:19:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2014-02-26 22:19:00 [CRITICAL] MGT underflow detected on beam(s) 1
2014-02-26 22:19:00 [DEBUG   ] Finished updating board flags in 1.983 seconds
2014-02-26 22:19:19 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-26 22:19:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-26 22:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:19:59 [DEBUG   ] Finished updating ant stats in 1.247 seconds
2014-02-26 22:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:20:00 [DEBUG   ] Finished updating board flags in 1.809 seconds
2014-02-26 22:20:19 [DEBUG   ] Finished updating ant stats in 1.147 seconds
2014-02-26 22:20:39 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-26 22:20:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:20:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:20:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:20:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:20:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:20:59 [DEBUG   ] Finished updating ant stats in 1.048 seconds
2014-02-26 22:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:21:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2014-02-26 22:21:00 [CRITICAL] MGT underflow detected on beam(s) 1
2014-02-26 22:21:00 [DEBUG   ] Finished updating board flags in 1.795 seconds
2014-02-26 22:21:19 [DEBUG   ] Finished updating ant stats in 0.956 seconds
2014-02-26 22:21:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 22:21:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:21:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:21:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:21:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:21:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:21:59 [DEBUG   ] Finished updating ant stats in 0.852 seconds
2014-02-26 22:22:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:22:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:22:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:22:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:22:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:22:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-26 22:22:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 22:22:00 [DEBUG   ] Finished updating board flags in 1.614 seconds
2014-02-26 22:22:19 [DEBUG   ] Finished updating ant stats in 0.753 seconds
2014-02-26 22:22:35 [DEBUG   ] Got command RPT from MCS: ref #287630
2014-02-26 22:22:35 [DEBUG   ] summary = ERROR
2014-02-26 22:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287630  13 56714 80555578 A  ERRORERROR'
2014-02-26 22:22:35 [DEBUG   ] Got command RPT from MCS: ref #287631
2014-02-26 22:22:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 22:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287631  77 56714 80555578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 22:22:39 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 22:22:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:22:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:22:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:22:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:22:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:22:59 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2014-02-26 22:22:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-26 22:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:23:00 [DEBUG   ] Finished updating board flags in 1.586 seconds
2014-02-26 22:23:19 [DEBUG   ] Finished updating ant stats in 0.556 seconds
2014-02-26 22:23:40 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-02-26 22:23:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:23:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:23:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:23:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:23:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:24:00 [DEBUG   ] Finished updating ant stats in 1.251 seconds
2014-02-26 22:24:00 [DEBUG   ] Finished updating board flags in 1.484 seconds
2014-02-26 22:24:20 [DEBUG   ] Finished updating ant stats in 1.159 seconds
2014-02-26 22:24:40 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2014-02-26 22:24:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:24:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:24:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:24:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:24:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:25:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:25:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:25:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:25:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:25:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:25:00 [DEBUG   ] Finished updating ant stats in 1.045 seconds
2014-02-26 22:25:00 [DEBUG   ] Finished updating board flags in 1.435 seconds
2014-02-26 22:25:20 [DEBUG   ] Finished updating ant stats in 0.955 seconds
2014-02-26 22:25:40 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-26 22:25:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:25:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:25:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:25:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:25:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:26:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:26:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:26:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:26:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:26:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:26:00 [DEBUG   ] Finished updating ant stats in 0.844 seconds
2014-02-26 22:26:00 [DEBUG   ] Finished updating board flags in 1.455 seconds
2014-02-26 22:26:20 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2014-02-26 22:26:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 22:26:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:26:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:26:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:26:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:26:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:27:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:27:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:27:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:27:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:27:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:27:00 [DEBUG   ] Finished updating ant stats in 0.649 seconds
2014-02-26 22:27:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2014-02-26 22:27:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 22:27:00 [CRITICAL] MGT underflow detected on beam(s) 1
2014-02-26 22:27:00 [DEBUG   ] Finished updating board flags in 1.426 seconds
2014-02-26 22:27:20 [DEBUG   ] Finished updating ant stats in 0.557 seconds
2014-02-26 22:27:35 [DEBUG   ] Got command RPT from MCS: ref #287647
2014-02-26 22:27:35 [DEBUG   ] summary = ERROR
2014-02-26 22:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287647  13 56714 80855574 A  ERRORERROR'
2014-02-26 22:27:35 [DEBUG   ] Got command RPT from MCS: ref #287648
2014-02-26 22:27:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 22:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287648  77 56714 80855574 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 22:27:41 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-02-26 22:27:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:27:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:27:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:27:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:27:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:28:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:28:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:28:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:28:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:28:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:28:00 [DEBUG   ] Finished updating board flags in 1.423 seconds
2014-02-26 22:28:01 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2014-02-26 22:28:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-26 22:28:41 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 22:28:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:28:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:28:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:28:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:28:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:29:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:29:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:29:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:29:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:29:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:29:00 [DEBUG   ] Finished updating board flags in 1.459 seconds
2014-02-26 22:29:01 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-26 22:29:21 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-26 22:29:41 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-26 22:30:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:30:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:30:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:30:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:30:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:30:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:30:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:30:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:30:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:30:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:30:01 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2014-02-26 22:30:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 22:30:01 [DEBUG   ] Finished updating board flags in 2.205 seconds
2014-02-26 22:30:21 [DEBUG   ] Finished updating ant stats in 0.754 seconds
2014-02-26 22:30:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 22:31:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:31:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:31:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:31:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:31:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:31:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:31:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:31:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:31:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:31:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:31:01 [DEBUG   ] Finished updating ant stats in 0.644 seconds
2014-02-26 22:31:01 [DEBUG   ] Finished updating board flags in 2.204 seconds
2014-02-26 22:31:21 [DEBUG   ] Finished updating ant stats in 0.556 seconds
2014-02-26 22:31:41 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2014-02-26 22:32:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:32:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:32:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:32:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:32:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:32:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:32:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:32:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:32:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:32:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:32:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 22:32:01 [DEBUG   ] Finished updating board flags in 2.215 seconds
2014-02-26 22:32:02 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 22:32:22 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-02-26 22:32:35 [DEBUG   ] Got command RPT from MCS: ref #287664
2014-02-26 22:32:35 [DEBUG   ] summary = ERROR
2014-02-26 22:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287664  13 56714 81155574 A  ERRORERROR'
2014-02-26 22:32:35 [DEBUG   ] Got command RPT from MCS: ref #287665
2014-02-26 22:32:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 22:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287665  77 56714 81155574 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 22:32:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 22:33:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:33:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:33:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:33:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:33:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:33:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:33:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:33:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:33:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:33:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:33:01 [DEBUG   ] Finished updating board flags in 2.168 seconds
2014-02-26 22:33:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 22:33:22 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 22:33:42 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-26 22:34:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:34:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:34:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:34:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:34:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:34:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:34:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:34:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:34:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:34:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:34:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-26 22:34:02 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-26 22:34:02 [DEBUG   ] Finished updating board flags in 2.725 seconds
2014-02-26 22:34:22 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 22:34:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 22:35:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:35:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:35:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:35:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:35:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:35:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:35:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:35:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:35:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:35:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:35:01 [DEBUG   ] Finished updating board flags in 1.882 seconds
2014-02-26 22:35:02 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-26 22:35:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 22:35:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 22:36:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:36:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:36:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:36:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:36:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:36:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:36:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:36:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:36:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:36:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:36:01 [DEBUG   ] Finished updating board flags in 1.770 seconds
2014-02-26 22:36:02 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-26 22:36:22 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-26 22:36:42 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-26 22:37:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:37:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:37:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:37:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:37:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:37:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-26 22:37:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:37:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:37:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:37:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:37:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:37:01 [DEBUG   ] Finished updating board flags in 1.579 seconds
2014-02-26 22:37:03 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-02-26 22:37:23 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-26 22:37:35 [DEBUG   ] Got command RPT from MCS: ref #287681
2014-02-26 22:37:35 [DEBUG   ] summary = ERROR
2014-02-26 22:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287681  13 56714 81455577 A  ERRORERROR'
2014-02-26 22:37:35 [DEBUG   ] Got command RPT from MCS: ref #287682
2014-02-26 22:37:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 22:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287682  77 56714 81455578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 22:37:43 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-26 22:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:38:01 [DEBUG   ] Finished updating board flags in 1.426 seconds
2014-02-26 22:38:03 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2014-02-26 22:38:23 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-26 22:38:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 22:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:39:01 [DEBUG   ] Finished updating board flags in 1.388 seconds
2014-02-26 22:39:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 22:39:23 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-26 22:39:43 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-26 22:40:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:40:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:40:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:40:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:40:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:40:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:40:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:40:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:40:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:40:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:40:02 [DEBUG   ] Finished updating board flags in 2.219 seconds
2014-02-26 22:40:03 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-02-26 22:40:24 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-26 22:40:43 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2014-02-26 22:41:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:41:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:41:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:41:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:41:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:41:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-26 22:41:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:41:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:41:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:41:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:41:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:41:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 22:41:02 [DEBUG   ] Finished updating board flags in 2.172 seconds
2014-02-26 22:41:04 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-02-26 22:41:24 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2014-02-26 22:41:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-26 22:42:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:42:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:42:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:42:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:42:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:42:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:42:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:42:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:42:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:42:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:42:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2014-02-26 22:42:02 [DEBUG   ] Finished updating board flags in 2.023 seconds
2014-02-26 22:42:04 [DEBUG   ] Finished updating ant stats in 1.192 seconds
2014-02-26 22:42:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 22:42:35 [DEBUG   ] Got command RPT from MCS: ref #287698
2014-02-26 22:42:35 [DEBUG   ] summary = ERROR
2014-02-26 22:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287698  13 56714 81755585 A  ERRORERROR'
2014-02-26 22:42:35 [DEBUG   ] Got command RPT from MCS: ref #287699
2014-02-26 22:42:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 22:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287699  77 56714 81755586 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 22:42:44 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-26 22:43:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:43:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:43:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:43:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:43:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:43:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:43:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:43:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:43:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:43:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:43:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 22:43:02 [DEBUG   ] Finished updating board flags in 2.004 seconds
2014-02-26 22:43:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 22:43:24 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 22:43:44 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-26 22:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:44:02 [DEBUG   ] Finished updating board flags in 2.003 seconds
2014-02-26 22:44:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-26 22:44:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 22:44:44 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 22:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:45:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-26 22:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:45:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 22:45:02 [DEBUG   ] Finished updating board flags in 2.010 seconds
2014-02-26 22:45:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 22:45:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 22:45:44 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-26 22:46:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:46:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:46:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:46:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:46:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:46:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:46:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:46:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:46:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:46:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:46:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 22:46:02 [DEBUG   ] Finished updating board flags in 1.986 seconds
2014-02-26 22:46:04 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 22:46:25 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-02-26 22:46:45 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-26 22:47:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:47:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:47:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:47:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:47:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:47:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:47:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:47:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:47:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:47:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:47:02 [DEBUG   ] Finished updating board flags in 1.807 seconds
2014-02-26 22:47:05 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 22:47:25 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-26 22:47:35 [DEBUG   ] Got command RPT from MCS: ref #287715
2014-02-26 22:47:35 [DEBUG   ] summary = ERROR
2014-02-26 22:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287715  13 56714 82055577 A  ERRORERROR'
2014-02-26 22:47:35 [DEBUG   ] Got command RPT from MCS: ref #287716
2014-02-26 22:47:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 22:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287716  77 56714 82055578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 22:47:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 22:48:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:48:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:48:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:48:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:48:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:48:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:48:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:48:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:48:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:48:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:48:02 [DEBUG   ] Finished updating board flags in 1.798 seconds
2014-02-26 22:48:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 22:48:25 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-26 22:48:45 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-26 22:49:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:49:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:49:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:49:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:49:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:49:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:49:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:49:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:49:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:49:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:49:02 [DEBUG   ] Finished updating board flags in 1.604 seconds
2014-02-26 22:49:06 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-26 22:49:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 22:49:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 22:50:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:50:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:50:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:50:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:50:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:50:02 [DEBUG   ] Finished updating board flags in 1.621 seconds
2014-02-26 22:50:06 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-26 22:50:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-26 22:50:46 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 22:51:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:51:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:51:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:51:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:51:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:51:02 [DEBUG   ] Finished updating board flags in 1.616 seconds
2014-02-26 22:51:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 22:51:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 22:51:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 22:52:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:52:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:52:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:52:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:52:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:52:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:52:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:52:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:52:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:52:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:52:02 [DEBUG   ] Finished updating board flags in 1.605 seconds
2014-02-26 22:52:06 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-26 22:52:26 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-26 22:52:35 [DEBUG   ] Got command RPT from MCS: ref #287732
2014-02-26 22:52:35 [DEBUG   ] summary = ERROR
2014-02-26 22:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287732  13 56714 82355581 A  ERRORERROR'
2014-02-26 22:52:35 [DEBUG   ] Got command RPT from MCS: ref #287733
2014-02-26 22:52:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 22:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287733  77 56714 82355582 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 22:52:46 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-26 22:53:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:53:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:53:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:53:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:53:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:53:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:53:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:53:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:53:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:53:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:53:02 [DEBUG   ] Finished updating board flags in 1.553 seconds
2014-02-26 22:53:06 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 22:53:26 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-02-26 22:53:46 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2014-02-26 22:54:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:54:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:54:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:54:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:54:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:54:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:54:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:54:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:54:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:54:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:54:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 22:54:02 [DEBUG   ] Finished updating board flags in 1.422 seconds
2014-02-26 22:54:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 22:54:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-26 22:54:47 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-26 22:55:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:55:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:55:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:55:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:55:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:55:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-26 22:55:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:55:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:55:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:55:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:55:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:55:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-02-26 22:55:02 [DEBUG   ] Finished updating board flags in 1.382 seconds
2014-02-26 22:55:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 22:55:27 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-26 22:55:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 22:56:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:56:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:56:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:56:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:56:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:56:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:56:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:56:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:56:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:56:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:56:02 [DEBUG   ] Finished updating board flags in 1.352 seconds
2014-02-26 22:56:07 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-26 22:56:28 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-26 22:56:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 22:57:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:57:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:57:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:57:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:57:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:57:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:57:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:57:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:57:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:57:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:57:03 [DEBUG   ] Finished updating board flags in 2.067 seconds
2014-02-26 22:57:08 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-26 22:57:28 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 22:57:35 [DEBUG   ] Got command RPT from MCS: ref #287749
2014-02-26 22:57:35 [DEBUG   ] summary = ERROR
2014-02-26 22:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287749  13 56714 82655589 A  ERRORERROR'
2014-02-26 22:57:35 [DEBUG   ] Got command RPT from MCS: ref #287750
2014-02-26 22:57:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 22:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287750  77 56714 82655590 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 22:57:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 22:58:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:58:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:58:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:58:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:58:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:58:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:58:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:58:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:58:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:58:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:58:03 [DEBUG   ] Finished updating board flags in 1.994 seconds
2014-02-26 22:58:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 22:58:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 22:58:48 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 22:59:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 22:59:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 22:59:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 22:59:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 22:59:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 22:59:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 22:59:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 22:59:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 22:59:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 22:59:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 22:59:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 22:59:03 [DEBUG   ] Finished updating board flags in 1.798 seconds
2014-02-26 22:59:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 22:59:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 22:59:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-26 23:00:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:00:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:00:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:00:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:00:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:00:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:00:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:00:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:00:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:00:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:00:03 [DEBUG   ] Finished updating board flags in 1.619 seconds
2014-02-26 23:00:08 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 23:00:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-26 23:00:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 23:01:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:01:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:01:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:01:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:01:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:01:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:01:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:01:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:01:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:01:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:01:03 [DEBUG   ] Finished updating board flags in 1.578 seconds
2014-02-26 23:01:08 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-26 23:01:28 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 23:01:48 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-26 23:02:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:02:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:02:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:02:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:02:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:02:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:02:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:02:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:02:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:02:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:02:03 [DEBUG   ] Finished updating board flags in 1.417 seconds
2014-02-26 23:02:09 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-02-26 23:02:29 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2014-02-26 23:02:35 [DEBUG   ] Got command RPT from MCS: ref #287766
2014-02-26 23:02:35 [DEBUG   ] summary = ERROR
2014-02-26 23:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287766  13 56714 82955582 A  ERRORERROR'
2014-02-26 23:02:35 [DEBUG   ] Got command RPT from MCS: ref #287767
2014-02-26 23:02:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 23:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287767  77 56714 82955582 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 23:02:49 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 23:03:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:03:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:03:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:03:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:03:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:03:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:03:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:03:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:03:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:03:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:03:03 [DEBUG   ] Finished updating board flags in 1.389 seconds
2014-02-26 23:03:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 23:03:29 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 23:03:49 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-26 23:04:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:04:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:04:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:04:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:04:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:04:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:04:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:04:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:04:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:04:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:04:03 [DEBUG   ] Finished updating board flags in 1.362 seconds
2014-02-26 23:04:09 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2014-02-26 23:04:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 23:04:49 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-26 23:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:05:04 [DEBUG   ] Finished updating board flags in 2.058 seconds
2014-02-26 23:05:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 23:05:29 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-26 23:05:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 23:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:06:04 [DEBUG   ] Finished updating board flags in 1.983 seconds
2014-02-26 23:06:09 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-26 23:06:30 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-02-26 23:06:50 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-26 23:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:07:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 23:07:04 [DEBUG   ] Finished updating board flags in 1.820 seconds
2014-02-26 23:07:10 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 23:07:30 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 23:07:35 [DEBUG   ] Got command RPT from MCS: ref #287783
2014-02-26 23:07:35 [DEBUG   ] summary = ERROR
2014-02-26 23:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287783  13 56714 83255581 A  ERRORERROR'
2014-02-26 23:07:35 [DEBUG   ] Got command RPT from MCS: ref #287784
2014-02-26 23:07:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 23:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287784  77 56714 83255582 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 23:07:50 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 23:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:08:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 23:08:04 [DEBUG   ] Finished updating board flags in 1.806 seconds
2014-02-26 23:08:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 23:08:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 23:08:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 23:09:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:09:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:09:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:09:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:09:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:09:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:09:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:09:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:09:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:09:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:09:04 [DEBUG   ] Finished updating board flags in 1.816 seconds
2014-02-26 23:09:10 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2014-02-26 23:09:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 23:09:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-26 23:10:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:10:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:10:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:10:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:10:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:10:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:10:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:10:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:10:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:10:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:10:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 23:10:04 [DEBUG   ] Finished updating board flags in 1.784 seconds
2014-02-26 23:10:10 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 23:10:30 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-26 23:10:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 23:11:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:11:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:11:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:11:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:11:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:11:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:11:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:11:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:11:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:11:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:11:04 [DEBUG   ] Finished updating board flags in 1.612 seconds
2014-02-26 23:11:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 23:11:30 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2014-02-26 23:11:51 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-02-26 23:12:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:12:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:12:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:12:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:12:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:12:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:12:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:12:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:12:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:12:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:12:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-26 23:12:04 [DEBUG   ] Finished updating board flags in 1.599 seconds
2014-02-26 23:12:11 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-26 23:12:31 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 23:12:35 [DEBUG   ] Got command RPT from MCS: ref #287800
2014-02-26 23:12:35 [DEBUG   ] summary = ERROR
2014-02-26 23:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287800  13 56714 83555589 A  ERRORERROR'
2014-02-26 23:12:35 [DEBUG   ] Got command RPT from MCS: ref #287801
2014-02-26 23:12:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 23:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287801  77 56714 83555590 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 23:12:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 23:13:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:13:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:13:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:13:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:13:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:13:04 [DEBUG   ] Finished updating board flags in 1.382 seconds
2014-02-26 23:13:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 23:13:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 23:13:51 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-26 23:14:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:14:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:14:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:14:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:14:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:14:04 [DEBUG   ] Finished updating board flags in 1.404 seconds
2014-02-26 23:14:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 23:14:31 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 23:14:51 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 23:15:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:15:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:15:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:15:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:15:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:15:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:15:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:15:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:15:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:15:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:15:05 [DEBUG   ] Finished updating board flags in 2.230 seconds
2014-02-26 23:15:11 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 23:15:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 23:15:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 23:16:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:16:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:16:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:16:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:16:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:16:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:16:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:16:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:16:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:16:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:16:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 23:16:05 [DEBUG   ] Finished updating board flags in 2.170 seconds
2014-02-26 23:16:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 23:16:31 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 23:16:52 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-02-26 23:17:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:17:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:17:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:17:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:17:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:17:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:17:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:17:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:17:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:17:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:17:05 [DEBUG   ] Finished updating board flags in 2.009 seconds
2014-02-26 23:17:12 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-26 23:17:32 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 23:17:35 [DEBUG   ] Got command RPT from MCS: ref #287817
2014-02-26 23:17:35 [DEBUG   ] summary = ERROR
2014-02-26 23:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287817  13 56714 83855589 A  ERRORERROR'
2014-02-26 23:17:35 [DEBUG   ] Got command RPT from MCS: ref #287818
2014-02-26 23:17:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 23:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287818  77 56714 83855590 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 23:17:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 23:18:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:18:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:18:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:18:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:18:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:18:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:18:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:18:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:18:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:18:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:18:05 [DEBUG   ] Finished updating board flags in 2.010 seconds
2014-02-26 23:18:12 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-26 23:18:32 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 23:18:52 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-26 23:19:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:19:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:19:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:19:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:19:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:19:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:19:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:19:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:19:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:19:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:19:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 23:19:05 [DEBUG   ] Finished updating board flags in 2.002 seconds
2014-02-26 23:19:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 23:19:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 23:19:52 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-26 23:20:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:20:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:20:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:20:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:20:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:20:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:20:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:20:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:20:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:20:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:20:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 23:20:05 [DEBUG   ] Finished updating board flags in 2.000 seconds
2014-02-26 23:20:12 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 23:20:32 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-02-26 23:20:53 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-26 23:21:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:21:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:21:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:21:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:21:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:21:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:21:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:21:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:21:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:21:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:21:05 [DEBUG   ] Finished updating board flags in 1.790 seconds
2014-02-26 23:21:13 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-26 23:21:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 23:21:53 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 23:22:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:22:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:22:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:22:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:22:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:22:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:22:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:22:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:22:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:22:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:22:05 [DEBUG   ] Finished updating board flags in 1.618 seconds
2014-02-26 23:22:13 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 23:22:33 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2014-02-26 23:22:35 [DEBUG   ] Got command RPT from MCS: ref #287834
2014-02-26 23:22:35 [DEBUG   ] summary = ERROR
2014-02-26 23:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287834  13 56714 84155585 A  ERRORERROR'
2014-02-26 23:22:35 [DEBUG   ] Got command RPT from MCS: ref #287835
2014-02-26 23:22:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 23:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287835  77 56714 84155586 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 23:22:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 23:23:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:23:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:23:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:23:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:23:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:23:05 [DEBUG   ] Finished updating board flags in 1.584 seconds
2014-02-26 23:23:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 23:23:33 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 23:23:53 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 23:24:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:24:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:24:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:24:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:24:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:24:05 [DEBUG   ] Finished updating board flags in 1.420 seconds
2014-02-26 23:24:13 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-02-26 23:24:34 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-26 23:24:54 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-02-26 23:25:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:25:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:25:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:25:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:25:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:25:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:25:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:25:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:25:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:25:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:25:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 23:25:05 [DEBUG   ] Finished updating board flags in 1.390 seconds
2014-02-26 23:25:14 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-26 23:25:34 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 23:25:54 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 23:26:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:26:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:26:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:26:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:26:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:26:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:26:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:26:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:26:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:26:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:26:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 23:26:05 [DEBUG   ] Finished updating board flags in 1.361 seconds
2014-02-26 23:26:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 23:26:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 23:26:54 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 23:27:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:27:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:27:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:27:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:27:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:27:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:27:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:27:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:27:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:27:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:27:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 23:27:06 [DEBUG   ] Finished updating board flags in 2.096 seconds
2014-02-26 23:27:14 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 23:27:34 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-02-26 23:27:35 [DEBUG   ] Got command RPT from MCS: ref #287851
2014-02-26 23:27:35 [DEBUG   ] summary = ERROR
2014-02-26 23:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287851  13 56714 84455593 A  ERRORERROR'
2014-02-26 23:27:35 [DEBUG   ] Got command RPT from MCS: ref #287852
2014-02-26 23:27:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 23:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287852  77 56714 84455594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 23:27:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 23:28:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:28:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:28:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:28:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:28:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:28:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:28:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:28:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:28:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:28:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:28:06 [DEBUG   ] Finished updating board flags in 1.946 seconds
2014-02-26 23:28:14 [DEBUG   ] Finished updating ant stats in 0.992 seconds
2014-02-26 23:28:34 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 23:28:54 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2014-02-26 23:29:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:29:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:29:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:29:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:29:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:29:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:29:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:29:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:29:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:29:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:29:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 23:29:06 [DEBUG   ] Finished updating board flags in 1.824 seconds
2014-02-26 23:29:15 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-26 23:29:35 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-26 23:29:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 23:30:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:30:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:30:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:30:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:30:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:30:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:30:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:30:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:30:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:30:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:30:06 [DEBUG   ] Finished updating board flags in 1.786 seconds
2014-02-26 23:30:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 23:30:35 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 23:30:55 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 23:31:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:31:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:31:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:31:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:31:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:31:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:31:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:31:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:31:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:31:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:31:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 23:31:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 23:31:06 [DEBUG   ] Finished updating board flags in 1.613 seconds
2014-02-26 23:31:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 23:31:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 23:31:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 23:32:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:32:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:32:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:32:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:32:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:32:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:32:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:32:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:32:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:32:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:32:06 [DEBUG   ] Finished updating board flags in 1.588 seconds
2014-02-26 23:32:15 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-26 23:32:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 23:32:35 [DEBUG   ] Got command RPT from MCS: ref #287868
2014-02-26 23:32:35 [DEBUG   ] summary = ERROR
2014-02-26 23:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287868  13 56714 84755589 A  ERRORERROR'
2014-02-26 23:32:35 [DEBUG   ] Got command RPT from MCS: ref #287869
2014-02-26 23:32:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 23:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287869  77 56714 84755590 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 23:32:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 23:33:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:33:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:33:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:33:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:33:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:33:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:33:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:33:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:33:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:33:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:33:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 23:33:06 [DEBUG   ] Finished updating board flags in 1.424 seconds
2014-02-26 23:33:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-26 23:33:35 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-26 23:33:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 23:34:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:34:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:34:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:34:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:34:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:34:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:34:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:34:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:34:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:34:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:34:06 [DEBUG   ] Finished updating board flags in 1.387 seconds
2014-02-26 23:34:15 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 23:34:35 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 23:34:55 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-26 23:35:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:35:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:35:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:35:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:35:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:35:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:35:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:35:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:35:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:35:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:35:07 [DEBUG   ] Finished updating board flags in 2.249 seconds
2014-02-26 23:35:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-26 23:35:35 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-02-26 23:35:56 [DEBUG   ] Finished updating ant stats in 1.392 seconds
2014-02-26 23:36:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:36:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:36:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:36:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:36:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:36:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:36:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:36:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:36:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:36:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:36:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-02-26 23:36:07 [DEBUG   ] Finished updating board flags in 2.211 seconds
2014-02-26 23:36:16 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-26 23:36:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 23:36:56 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 23:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:37:07 [DEBUG   ] Finished updating board flags in 2.130 seconds
2014-02-26 23:37:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 23:37:35 [DEBUG   ] Got command RPT from MCS: ref #287885
2014-02-26 23:37:35 [DEBUG   ] summary = ERROR
2014-02-26 23:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287885  13 56714 85055598 A  ERRORERROR'
2014-02-26 23:37:35 [DEBUG   ] Got command RPT from MCS: ref #287886
2014-02-26 23:37:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 23:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287886  77 56714 85055598 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 23:37:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 23:37:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 23:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:38:07 [DEBUG   ] Finished updating board flags in 2.023 seconds
2014-02-26 23:38:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 23:38:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 23:38:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 23:39:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:39:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:39:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:39:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:39:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:39:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:39:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:39:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:39:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:39:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:39:07 [DEBUG   ] Finished updating board flags in 2.039 seconds
2014-02-26 23:39:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 23:39:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 23:39:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 23:40:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:40:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:40:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:40:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:40:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:40:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:40:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:40:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:40:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:40:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:40:07 [DEBUG   ] Finished updating board flags in 2.025 seconds
2014-02-26 23:40:16 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-26 23:40:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-26 23:40:56 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-26 23:41:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:41:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:41:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:41:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:41:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:41:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:41:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:41:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:41:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:41:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:41:07 [DEBUG   ] Finished updating board flags in 1.927 seconds
2014-02-26 23:41:16 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-26 23:41:37 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-02-26 23:41:57 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-26 23:42:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:42:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:42:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:42:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:42:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:42:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:42:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:42:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:42:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:42:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:42:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 23:42:07 [DEBUG   ] Finished updating board flags in 1.821 seconds
2014-02-26 23:42:17 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2014-02-26 23:42:35 [DEBUG   ] Got command RPT from MCS: ref #287902
2014-02-26 23:42:35 [DEBUG   ] summary = ERROR
2014-02-26 23:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287902  13 56714 85355597 A  ERRORERROR'
2014-02-26 23:42:35 [DEBUG   ] Got command RPT from MCS: ref #287903
2014-02-26 23:42:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 23:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287903  77 56714 85355598 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 23:42:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 23:42:57 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 23:43:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:43:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:43:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:43:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:43:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:43:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:43:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:43:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:43:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:43:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:43:07 [DEBUG   ] Finished updating board flags in 1.786 seconds
2014-02-26 23:43:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-26 23:43:37 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-26 23:43:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 23:44:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:44:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:44:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:44:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:44:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:44:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:44:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:44:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:44:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:44:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:44:07 [DEBUG   ] Finished updating board flags in 1.623 seconds
2014-02-26 23:44:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 23:44:37 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-26 23:44:57 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-26 23:45:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:45:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:45:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:45:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:45:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:45:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:45:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:45:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:45:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:45:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:45:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 23:45:07 [DEBUG   ] Finished updating board flags in 1.579 seconds
2014-02-26 23:45:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-26 23:45:38 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-26 23:45:58 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-26 23:46:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:46:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:46:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:46:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:46:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:46:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-26 23:46:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:46:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:46:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:46:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:46:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:46:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 23:46:07 [DEBUG   ] Finished updating board flags in 1.414 seconds
2014-02-26 23:46:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 23:46:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 23:46:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 23:47:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:47:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:47:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:47:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:47:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:47:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:47:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:47:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:47:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:47:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:47:07 [DEBUG   ] Finished updating board flags in 1.421 seconds
2014-02-26 23:47:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-26 23:47:35 [DEBUG   ] Got command RPT from MCS: ref #287919
2014-02-26 23:47:35 [DEBUG   ] summary = ERROR
2014-02-26 23:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287919  13 56714 85655597 A  ERRORERROR'
2014-02-26 23:47:35 [DEBUG   ] Got command RPT from MCS: ref #287920
2014-02-26 23:47:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 23:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287920  77 56714 85655598 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 23:47:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 23:47:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 23:48:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:48:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:48:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:48:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:48:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:48:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:48:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:48:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:48:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:48:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:48:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 23:48:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 23:48:07 [DEBUG   ] Finished updating board flags in 1.455 seconds
2014-02-26 23:48:18 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 23:48:38 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-02-26 23:48:58 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-26 23:49:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:49:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:49:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:49:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:49:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:49:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:49:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:49:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:49:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:49:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:49:07 [DEBUG   ] Finished updating board flags in 1.454 seconds
2014-02-26 23:49:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-26 23:49:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-26 23:49:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-26 23:50:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:50:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:50:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:50:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:50:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:50:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:50:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:50:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:50:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:50:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:50:07 [DEBUG   ] Finished updating board flags in 1.449 seconds
2014-02-26 23:50:18 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-26 23:50:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-26 23:50:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-26 23:51:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:51:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:51:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:51:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:51:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:51:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:51:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:51:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:51:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:51:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:51:07 [DEBUG   ] Finished updating board flags in 1.458 seconds
2014-02-26 23:51:18 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2014-02-26 23:51:38 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-26 23:51:59 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-02-26 23:52:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:52:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:52:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:52:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:52:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:52:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:52:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:52:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:52:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:52:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:52:08 [DEBUG   ] Finished updating board flags in 2.203 seconds
2014-02-26 23:52:19 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-26 23:52:35 [DEBUG   ] Got command RPT from MCS: ref #287936
2014-02-26 23:52:35 [DEBUG   ] summary = ERROR
2014-02-26 23:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287936  13 56714 85955593 A  ERRORERROR'
2014-02-26 23:52:35 [DEBUG   ] Got command RPT from MCS: ref #287937
2014-02-26 23:52:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 23:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287937  77 56714 85955594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 23:52:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-26 23:52:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-26 23:53:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:53:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:53:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:53:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:53:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:53:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:53:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:53:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:53:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:53:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:53:08 [DEBUG   ] Finished updating board flags in 2.210 seconds
2014-02-26 23:53:19 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-26 23:53:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-26 23:53:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 23:54:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:54:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:54:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:54:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:54:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:54:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:54:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:54:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:54:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:54:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:54:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-26 23:54:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 23:54:08 [DEBUG   ] Finished updating board flags in 2.160 seconds
2014-02-26 23:54:19 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-26 23:54:39 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-26 23:54:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 23:55:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:55:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:55:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:55:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:55:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:55:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:55:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:55:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:55:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:55:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:55:08 [DEBUG   ] Finished updating board flags in 2.009 seconds
2014-02-26 23:55:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-26 23:55:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-26 23:55:59 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-26 23:56:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:56:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:56:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:56:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:56:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:56:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:56:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:56:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:56:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:56:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:56:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2014-02-26 23:56:08 [CRITICAL] MGT underflow detected on beam(s) 1
2014-02-26 23:56:08 [DEBUG   ] Finished updating board flags in 2.060 seconds
2014-02-26 23:56:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-26 23:56:39 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-26 23:56:59 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-02-26 23:57:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:57:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:57:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:57:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:57:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:57:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:57:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:57:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:57:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:57:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:57:08 [DEBUG   ] Finished updating board flags in 1.953 seconds
2014-02-26 23:57:20 [DEBUG   ] Finished updating ant stats in 1.391 seconds
2014-02-26 23:57:35 [DEBUG   ] Got command RPT from MCS: ref #287953
2014-02-26 23:57:35 [DEBUG   ] summary = ERROR
2014-02-26 23:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287953  13 56714 86255598 A  ERRORERROR'
2014-02-26 23:57:35 [DEBUG   ] Got command RPT from MCS: ref #287954
2014-02-26 23:57:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-26 23:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287954  77 56714 86255598 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-26 23:57:40 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-26 23:58:00 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 23:58:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:58:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:58:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:58:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:58:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:58:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:58:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:58:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:58:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:58:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:58:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-26 23:58:08 [DEBUG   ] Finished updating board flags in 1.785 seconds
2014-02-26 23:58:20 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-26 23:58:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-26 23:59:00 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-26 23:59:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-26 23:59:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-26 23:59:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-26 23:59:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-26 23:59:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-26 23:59:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-26 23:59:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-26 23:59:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-26 23:59:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-26 23:59:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-26 23:59:08 [DEBUG   ] Finished updating board flags in 1.596 seconds
2014-02-26 23:59:20 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-26 23:59:40 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 00:00:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 00:00:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:00:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:00:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:00:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:00:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:00:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:00:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:00:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:00:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:00:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:00:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2014-02-27 00:00:08 [CRITICAL] MGT underflow detected on beam(s) 1
2014-02-27 00:00:08 [DEBUG   ] Finished updating board flags in 1.417 seconds
2014-02-27 00:00:20 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2014-02-27 00:00:40 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 00:01:00 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 00:01:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:01:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:01:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:01:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:01:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:01:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:01:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:01:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:01:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:01:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:01:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 00:01:08 [DEBUG   ] Finished updating board flags in 1.399 seconds
2014-02-27 00:01:21 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-02-27 00:01:41 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-27 00:02:01 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 00:02:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:02:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:02:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:02:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:02:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:02:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:02:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:02:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:02:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:02:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:02:09 [DEBUG   ] Finished updating board flags in 2.209 seconds
2014-02-27 00:02:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-02-27 00:02:35 [DEBUG   ] Got command RPT from MCS: ref #287970
2014-02-27 00:02:35 [DEBUG   ] summary = ERROR
2014-02-27 00:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287970  13 56715   155597 A  ERRORERROR'
2014-02-27 00:02:35 [DEBUG   ] Got command RPT from MCS: ref #287971
2014-02-27 00:02:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 00:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287971  77 56715   155598 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 00:02:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 00:03:01 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 00:03:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:03:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:03:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:03:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:03:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:03:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 00:03:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:03:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:03:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:03:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:03:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:03:09 [DEBUG   ] Finished updating board flags in 2.183 seconds
2014-02-27 00:03:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 00:03:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 00:04:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 00:04:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:04:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:04:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:04:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:04:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:04:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:04:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:04:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:04:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:04:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:04:09 [DEBUG   ] Finished updating board flags in 2.018 seconds
2014-02-27 00:04:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 00:04:41 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 00:05:01 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 00:05:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:05:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:05:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:05:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:05:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:05:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:05:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:05:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:05:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:05:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:05:09 [DEBUG   ] Finished updating board flags in 1.987 seconds
2014-02-27 00:05:22 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-02-27 00:05:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 00:06:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 00:06:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:06:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:06:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:06:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:06:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:06:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:06:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:06:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:06:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:06:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:06:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-02-27 00:06:09 [DEBUG   ] Finished updating board flags in 1.816 seconds
2014-02-27 00:06:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 00:06:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 00:07:02 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 00:07:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:07:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:07:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:07:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:07:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:07:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:07:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:07:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:07:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:07:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:07:09 [DEBUG   ] Finished updating board flags in 1.835 seconds
2014-02-27 00:07:22 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-27 00:07:35 [DEBUG   ] Got command RPT from MCS: ref #287987
2014-02-27 00:07:35 [DEBUG   ] summary = ERROR
2014-02-27 00:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287987  13 56715   455593 A  ERRORERROR'
2014-02-27 00:07:35 [DEBUG   ] Got command RPT from MCS: ref #287988
2014-02-27 00:07:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 00:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287988  77 56715   455594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 00:07:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 00:07:56 [DEBUG   ] Got command TBW from MCS: ref #288006
2014-02-27 00:07:56 [DEBUG   ] tbw = exited with status True, code 0x00
2014-02-27 00:07:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   288006   8 56715   476694 A  ERROR'
2014-02-27 00:07:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2014-02-27 00:07:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2014-02-27 00:07:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2014-02-27 00:07:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2014-02-27 00:07:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2014-02-27 00:07:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2014-02-27 00:07:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2014-02-27 00:07:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2014-02-27 00:07:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2014-02-27 00:07:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2014-02-27 00:07:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2014-02-27 00:07:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2014-02-27 00:07:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2014-02-27 00:07:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2014-02-27 00:07:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2014-02-27 00:07:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2014-02-27 00:07:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2014-02-27 00:07:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2014-02-27 00:07:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2014-02-27 00:07:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2014-02-27 00:07:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2014-02-27 00:07:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2014-02-27 00:07:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2014-02-27 00:07:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2014-02-27 00:07:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2014-02-27 00:07:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2014-02-27 00:08:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2014-02-27 00:08:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2014-02-27 00:08:00 [DEBUG   ] spawn_process: at 2014-02-27 00:08:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2014-02-27 00:08:00 [DEBUG   ] spawn_process: at 2014-02-27 00:08:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2014-02-27 00:08:00 [DEBUG   ] spawn_process: at 2014-02-27 00:08:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2014-02-27 00:08:00 [DEBUG   ] spawn_process: at 2014-02-27 00:08:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2014-02-27 00:08:00 [DEBUG   ] spawn_process: at 2014-02-27 00:08:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2014-02-27 00:08:00 [DEBUG   ] spawn_process: at 2014-02-27 00:08:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2014-02-27 00:08:00 [DEBUG   ] spawn_process: at 2014-02-27 00:08:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2014-02-27 00:08:00 [DEBUG   ] spawn_process: at 2014-02-27 00:08:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2014-02-27 00:08:00 [DEBUG   ] spawn_process: at 2014-02-27 00:08:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2014-02-27 00:08:00 [DEBUG   ] spawn_process: at 2014-02-27 00:08:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2014-02-27 00:08:00 [DEBUG   ] spawn_process: at 2014-02-27 00:08:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2014-02-27 00:08:00 [DEBUG   ] spawn_process: at 2014-02-27 00:08:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2014-02-27 00:08:00 [DEBUG   ] spawn_process: at 2014-02-27 00:08:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2014-02-27 00:08:00 [DEBUG   ] spawn_process: at 2014-02-27 00:08:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2014-02-27 00:08:00 [DEBUG   ] spawn_process: at 2014-02-27 00:08:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2014-02-27 00:08:00 [DEBUG   ] spawn_process: at 2014-02-27 00:08:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2014-02-27 00:08:00 [DEBUG   ] spawn_process: at 2014-02-27 00:08:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2014-02-27 00:08:00 [DEBUG   ] spawn_process: at 2014-02-27 00:08:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2014-02-27 00:08:00 [DEBUG   ] spawn_process: at 2014-02-27 00:08:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2014-02-27 00:08:00 [DEBUG   ] spawn_process: at 2014-02-27 00:08:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2014-02-27 00:08:00 [DEBUG   ] spawn_process: at 2014-02-27 00:08:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2014-02-27 00:08:00 [DEBUG   ] spawn_process: at 2014-02-27 00:08:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2014-02-27 00:08:00 [DEBUG   ] spawn_process: at 2014-02-27 00:08:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2014-02-27 00:08:00 [DEBUG   ] spawn_process: at 2014-02-27 00:08:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2014-02-27 00:08:00 [DEBUG   ] spawn_process: at 2014-02-27 00:08:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2014-02-27 00:08:00 [DEBUG   ] spawn_process: at 2014-02-27 00:08:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2014-02-27 00:08:00 [INFO    ] Finished spawning TBW
2014-02-27 00:08:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:08:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:08:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:08:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:08:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:08:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:08:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:08:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:08:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:08:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:08:09 [DEBUG   ] Finished updating board flags in 1.580 seconds
2014-02-27 00:09:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:09:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:09:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:09:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:09:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:09:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:09:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:09:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:09:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:09:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:09:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 00:09:09 [DEBUG   ] Finished updating board flags in 1.510 seconds
2014-02-27 00:10:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:10:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:10:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:10:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:10:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:10:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:10:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:10:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:10:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:10:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:10:09 [DEBUG   ] Finished updating board flags in 1.429 seconds
2014-02-27 00:11:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:11:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:11:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:11:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:11:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:11:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:11:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:11:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:11:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:11:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:11:09 [DEBUG   ] Finished updating board flags in 1.256 seconds
2014-02-27 00:11:39 [INFO    ] __waitForTBW - TBW finished in 218.893 s
2014-02-27 00:11:40 [INFO    ] Started antennas statistics background thread
2014-02-27 00:11:40 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2014-02-27 00:11:40 [DEBUG   ] spawn_process: at 2014-02-27 00:11:40 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '1', '1393459901']
2014-02-27 00:11:40 [DEBUG   ] spawn_process: at 2014-02-27 00:11:40 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '2', '1393459901']
2014-02-27 00:11:40 [DEBUG   ] spawn_process: at 2014-02-27 00:11:40 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '3', '1393459901']
2014-02-27 00:11:40 [DEBUG   ] spawn_process: at 2014-02-27 00:11:40 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '4', '1393459901']
2014-02-27 00:11:40 [DEBUG   ] spawn_process: at 2014-02-27 00:11:40 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '5', '1393459901']
2014-02-27 00:11:40 [DEBUG   ] spawn_process: at 2014-02-27 00:11:40 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '6', '1393459901']
2014-02-27 00:11:40 [DEBUG   ] spawn_process: at 2014-02-27 00:11:40 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '7', '1393459901']
2014-02-27 00:11:40 [DEBUG   ] spawn_process: at 2014-02-27 00:11:40 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '8', '1393459901']
2014-02-27 00:11:40 [DEBUG   ] spawn_process: at 2014-02-27 00:11:40 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '9', '1393459901']
2014-02-27 00:11:40 [DEBUG   ] spawn_process: at 2014-02-27 00:11:40 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '10', '1393459901']
2014-02-27 00:11:40 [DEBUG   ] spawn_process: at 2014-02-27 00:11:40 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '11', '1393459901']
2014-02-27 00:11:40 [DEBUG   ] spawn_process: at 2014-02-27 00:11:40 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '12', '1393459901']
2014-02-27 00:11:40 [DEBUG   ] spawn_process: at 2014-02-27 00:11:40 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '13', '1393459901']
2014-02-27 00:11:40 [DEBUG   ] spawn_process: at 2014-02-27 00:11:40 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '14', '1393459901']
2014-02-27 00:11:40 [DEBUG   ] spawn_process: at 2014-02-27 00:11:40 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '15', '1393459901']
2014-02-27 00:11:40 [DEBUG   ] spawn_process: at 2014-02-27 00:11:40 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '16', '1393459901']
2014-02-27 00:11:40 [DEBUG   ] spawn_process: at 2014-02-27 00:11:40 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '17', '1393459901']
2014-02-27 00:11:40 [DEBUG   ] spawn_process: at 2014-02-27 00:11:40 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '18', '1393459901']
2014-02-27 00:11:40 [DEBUG   ] spawn_process: at 2014-02-27 00:11:40 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '19', '1393459901']
2014-02-27 00:11:40 [DEBUG   ] spawn_process: at 2014-02-27 00:11:40 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '20', '1393459901']
2014-02-27 00:11:40 [DEBUG   ] spawn_process: at 2014-02-27 00:11:40 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '21', '1393459901']
2014-02-27 00:11:40 [DEBUG   ] spawn_process: at 2014-02-27 00:11:40 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '22', '1393459901']
2014-02-27 00:11:40 [DEBUG   ] spawn_process: at 2014-02-27 00:11:40 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '23', '1393459901']
2014-02-27 00:11:40 [DEBUG   ] spawn_process: at 2014-02-27 00:11:40 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '24', '1393459901']
2014-02-27 00:11:40 [DEBUG   ] spawn_process: at 2014-02-27 00:11:40 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '25', '1393459901']
2014-02-27 00:11:40 [DEBUG   ] spawn_process: at 2014-02-27 00:11:40 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '26', '1393459901']
2014-02-27 00:11:40 [INFO    ] Finished spawning TBN in 0.053 s
2014-02-27 00:11:40 [DEBUG   ] Finished updating ant stats in 1.260 seconds
2014-02-27 00:12:00 [DEBUG   ] Finished updating ant stats in 1.186 seconds
2014-02-27 00:12:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:12:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:12:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:12:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:12:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:12:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:12:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:12:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:12:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:12:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:12:10 [DEBUG   ] Finished updating board flags in 2.398 seconds
2014-02-27 00:12:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 00:12:35 [DEBUG   ] Got command RPT from MCS: ref #288017
2014-02-27 00:12:35 [DEBUG   ] summary = ERROR
2014-02-27 00:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288017  13 56715   755597 A  ERRORERROR'
2014-02-27 00:12:35 [DEBUG   ] Got command RPT from MCS: ref #288018
2014-02-27 00:12:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 00:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288018  77 56715   755598 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 00:12:40 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 00:13:00 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-02-27 00:13:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:13:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:13:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:13:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:13:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:13:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:13:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:13:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:13:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:13:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:13:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 00:13:10 [DEBUG   ] Finished updating board flags in 2.207 seconds
2014-02-27 00:13:20 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 00:13:40 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 00:14:00 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 00:14:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:14:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:14:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:14:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:14:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:14:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 00:14:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:14:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:14:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:14:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:14:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:14:10 [DEBUG   ] Finished updating board flags in 2.212 seconds
2014-02-27 00:14:20 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 00:14:41 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-27 00:15:00 [DEBUG   ] Finished updating ant stats in 0.408 seconds
2014-02-27 00:15:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:15:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:15:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:15:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:15:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:15:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:15:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:15:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:15:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:15:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:15:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 00:15:10 [DEBUG   ] Finished updating board flags in 2.191 seconds
2014-02-27 00:15:20 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2014-02-27 00:15:41 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 00:16:01 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 00:16:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:16:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:16:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:16:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:16:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:16:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:16:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:16:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:16:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:16:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:16:10 [DEBUG   ] Finished updating board flags in 2.005 seconds
2014-02-27 00:16:21 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2014-02-27 00:16:41 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 00:17:01 [DEBUG   ] Finished updating ant stats in 0.875 seconds
2014-02-27 00:17:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:17:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:17:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:17:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:17:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:17:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:17:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:17:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:17:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:17:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:17:10 [DEBUG   ] Finished updating board flags in 1.986 seconds
2014-02-27 00:17:21 [DEBUG   ] Finished updating ant stats in 0.733 seconds
2014-02-27 00:17:35 [DEBUG   ] Got command RPT from MCS: ref #288035
2014-02-27 00:17:35 [DEBUG   ] summary = ERROR
2014-02-27 00:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288035  13 56715  1055598 A  ERRORERROR'
2014-02-27 00:17:35 [DEBUG   ] Got command RPT from MCS: ref #288036
2014-02-27 00:17:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 00:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288036  77 56715  1055598 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 00:17:41 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-02-27 00:18:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-27 00:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:18:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:18:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:18:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:18:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:18:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:18:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 00:18:10 [DEBUG   ] Finished updating board flags in 1.823 seconds
2014-02-27 00:18:21 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-02-27 00:18:42 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-02-27 00:19:02 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-27 00:19:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:19:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:19:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:19:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:19:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:19:10 [DEBUG   ] Finished updating board flags in 1.790 seconds
2014-02-27 00:19:22 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-27 00:19:42 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 00:20:02 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 00:20:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:20:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:20:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:20:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:20:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:20:10 [DEBUG   ] Finished updating board flags in 1.612 seconds
2014-02-27 00:20:22 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 00:20:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 00:21:02 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 00:21:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:21:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:21:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:21:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:21:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:21:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:21:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:21:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:21:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:21:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:21:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-27 00:21:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 00:21:10 [DEBUG   ] Finished updating board flags in 1.581 seconds
2014-02-27 00:21:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 00:21:42 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 00:22:02 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-02-27 00:22:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:22:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:22:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:22:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:22:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:22:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:22:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:22:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:22:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:22:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:22:10 [DEBUG   ] Finished updating board flags in 1.420 seconds
2014-02-27 00:22:22 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2014-02-27 00:22:35 [DEBUG   ] Got command RPT from MCS: ref #288052
2014-02-27 00:22:35 [DEBUG   ] summary = ERROR
2014-02-27 00:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288052  13 56715  1355605 A  ERRORERROR'
2014-02-27 00:22:35 [DEBUG   ] Got command RPT from MCS: ref #288053
2014-02-27 00:22:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 00:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288053  77 56715  1355606 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 00:22:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 00:23:03 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-27 00:23:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:23:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:23:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:23:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:23:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:23:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:23:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:23:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:23:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:23:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:23:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 00:23:10 [DEBUG   ] Finished updating board flags in 1.395 seconds
2014-02-27 00:23:23 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 00:23:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 00:24:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 00:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:24:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:24:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:24:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:24:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:24:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:24:10 [DEBUG   ] Finished updating board flags in 1.356 seconds
2014-02-27 00:24:23 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 00:24:43 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 00:25:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 00:25:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:25:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:25:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:25:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:25:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:25:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:25:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:25:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:25:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:25:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:25:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-27 00:25:11 [DEBUG   ] Finished updating board flags in 2.056 seconds
2014-02-27 00:25:23 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-27 00:25:43 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 00:26:03 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 00:26:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:26:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:26:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:26:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:26:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:26:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:26:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:26:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:26:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:26:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:26:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-27 00:26:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-02-27 00:26:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 00:26:11 [DEBUG   ] Finished updating board flags in 1.989 seconds
2014-02-27 00:26:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 00:26:43 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 00:27:03 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-02-27 00:27:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:27:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:27:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:27:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:27:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:27:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:27:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:27:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:27:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:27:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:27:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 00:27:11 [DEBUG   ] Finished updating board flags in 1.810 seconds
2014-02-27 00:27:23 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2014-02-27 00:27:35 [DEBUG   ] Got command RPT from MCS: ref #288069
2014-02-27 00:27:35 [DEBUG   ] summary = ERROR
2014-02-27 00:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288069  13 56715  1655602 A  ERRORERROR'
2014-02-27 00:27:35 [DEBUG   ] Got command RPT from MCS: ref #288070
2014-02-27 00:27:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 00:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288070  77 56715  1655602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 00:27:44 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 00:28:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-27 00:28:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:28:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:28:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:28:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:28:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:28:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:28:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:28:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:28:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:28:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:28:11 [DEBUG   ] Finished updating board flags in 1.812 seconds
2014-02-27 00:28:24 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 00:28:44 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-02-27 00:29:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 00:29:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:29:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:29:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:29:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:29:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:29:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:29:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:29:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:29:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:29:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:29:11 [DEBUG   ] Finished updating board flags in 1.791 seconds
2014-02-27 00:29:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 00:29:44 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 00:30:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 00:30:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:30:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:30:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:30:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:30:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:30:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:30:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:30:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:30:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:30:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:30:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-27 00:30:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 00:30:11 [DEBUG   ] Finished updating board flags in 1.608 seconds
2014-02-27 00:30:24 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 00:30:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 00:31:04 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 00:31:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:31:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:31:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:31:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:31:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:31:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:31:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:31:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:31:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:31:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:31:11 [DEBUG   ] Finished updating board flags in 1.612 seconds
2014-02-27 00:31:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 00:31:44 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 00:32:04 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2014-02-27 00:32:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:32:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:32:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:32:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:32:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:32:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:32:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:32:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:32:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:32:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:32:11 [DEBUG   ] Finished updating board flags in 1.585 seconds
2014-02-27 00:32:25 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-02-27 00:32:35 [DEBUG   ] Got command RPT from MCS: ref #288086
2014-02-27 00:32:35 [DEBUG   ] summary = ERROR
2014-02-27 00:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288086  13 56715  1955601 A  ERRORERROR'
2014-02-27 00:32:35 [DEBUG   ] Got command RPT from MCS: ref #288087
2014-02-27 00:32:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 00:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288087  77 56715  1955602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 00:32:45 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-27 00:33:05 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 00:33:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:33:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:33:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:33:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:33:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:33:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:33:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:33:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:33:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:33:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:33:11 [DEBUG   ] Finished updating board flags in 1.409 seconds
2014-02-27 00:33:25 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 00:33:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 00:34:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 00:34:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:34:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:34:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:34:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:34:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:34:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:34:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:34:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:34:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:34:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:34:11 [DEBUG   ] Finished updating board flags in 1.388 seconds
2014-02-27 00:34:25 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 00:34:45 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-27 00:35:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 00:35:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:35:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:35:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:35:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:35:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:35:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:35:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:35:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:35:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:35:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:35:11 [DEBUG   ] Finished updating board flags in 1.362 seconds
2014-02-27 00:35:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 00:35:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 00:36:05 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-02-27 00:36:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:36:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:36:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:36:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:36:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:36:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:36:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:36:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:36:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:36:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:36:12 [DEBUG   ] Finished updating board flags in 2.055 seconds
2014-02-27 00:36:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 00:36:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 00:37:05 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 00:37:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:37:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:37:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:37:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:37:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:37:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:37:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:37:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:37:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:37:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:37:12 [DEBUG   ] Finished updating board flags in 1.983 seconds
2014-02-27 00:37:25 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2014-02-27 00:37:35 [DEBUG   ] Got command RPT from MCS: ref #288103
2014-02-27 00:37:35 [DEBUG   ] summary = ERROR
2014-02-27 00:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288103  13 56715  2255601 A  ERRORERROR'
2014-02-27 00:37:35 [DEBUG   ] Got command RPT from MCS: ref #288104
2014-02-27 00:37:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 00:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288104  77 56715  2255602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 00:37:46 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-27 00:38:06 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-02-27 00:38:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:38:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:38:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:38:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:38:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:38:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:38:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:38:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:38:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:38:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:38:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-27 00:38:12 [DEBUG   ] Finished updating board flags in 1.824 seconds
2014-02-27 00:38:26 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-27 00:38:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 00:39:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 00:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:39:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 00:39:12 [DEBUG   ] Finished updating board flags in 1.786 seconds
2014-02-27 00:39:26 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 00:39:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 00:40:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 00:40:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:40:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:40:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:40:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:40:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:40:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 00:40:12 [DEBUG   ] Finished updating board flags in 1.622 seconds
2014-02-27 00:40:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 00:40:46 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 00:41:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 00:41:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:41:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:41:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:41:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:41:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:41:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:41:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:41:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:41:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:41:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:41:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 00:41:12 [DEBUG   ] Finished updating board flags in 1.582 seconds
2014-02-27 00:41:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 00:41:46 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 00:42:06 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 00:42:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:42:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:42:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:42:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:42:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:42:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:42:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:42:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:42:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:42:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:42:12 [DEBUG   ] Finished updating board flags in 1.438 seconds
2014-02-27 00:42:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 00:42:35 [DEBUG   ] Got command RPT from MCS: ref #288120
2014-02-27 00:42:35 [DEBUG   ] summary = ERROR
2014-02-27 00:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288120  13 56715  2555601 A  ERRORERROR'
2014-02-27 00:42:35 [DEBUG   ] Got command RPT from MCS: ref #288121
2014-02-27 00:42:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 00:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288121  77 56715  2555602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 00:42:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 00:43:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 00:43:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:43:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:43:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:43:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:43:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:43:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:43:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:43:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:43:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:43:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:43:12 [DEBUG   ] Finished updating board flags in 1.367 seconds
2014-02-27 00:43:26 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 00:43:47 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-02-27 00:44:07 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-27 00:44:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:44:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:44:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:44:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:44:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:44:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 00:44:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:44:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:44:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:44:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:44:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:44:12 [DEBUG   ] Finished updating board flags in 1.363 seconds
2014-02-27 00:44:27 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 00:44:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 00:45:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 00:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:45:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:45:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:45:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:45:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:45:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:45:13 [DEBUG   ] Finished updating board flags in 2.059 seconds
2014-02-27 00:45:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 00:45:47 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 00:46:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 00:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:46:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 00:46:13 [DEBUG   ] Finished updating board flags in 1.993 seconds
2014-02-27 00:46:27 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 00:46:47 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 00:47:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 00:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:47:13 [DEBUG   ] Finished updating board flags in 1.812 seconds
2014-02-27 00:47:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 00:47:35 [DEBUG   ] Got command RPT from MCS: ref #288137
2014-02-27 00:47:35 [DEBUG   ] summary = ERROR
2014-02-27 00:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288137  13 56715  2855605 A  ERRORERROR'
2014-02-27 00:47:35 [DEBUG   ] Got command RPT from MCS: ref #288138
2014-02-27 00:47:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 00:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288138  77 56715  2855606 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 00:47:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 00:48:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 00:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:48:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-27 00:48:13 [DEBUG   ] Finished updating board flags in 1.842 seconds
2014-02-27 00:48:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 00:48:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 00:49:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 00:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:49:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 00:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:49:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 00:49:13 [DEBUG   ] Finished updating board flags in 1.748 seconds
2014-02-27 00:49:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 00:49:47 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 00:50:07 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 00:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:50:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:50:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:50:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:50:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:50:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:50:13 [DEBUG   ] Finished updating board flags in 1.611 seconds
2014-02-27 00:50:28 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-02-27 00:50:48 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-27 00:51:08 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-02-27 00:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:51:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:51:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:51:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:51:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:51:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:51:13 [DEBUG   ] Finished updating board flags in 1.594 seconds
2014-02-27 00:51:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 00:51:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 00:52:08 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 00:52:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:52:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:52:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:52:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:52:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:52:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:52:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:52:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:52:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:52:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:52:13 [DEBUG   ] Finished updating board flags in 1.398 seconds
2014-02-27 00:52:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 00:52:35 [DEBUG   ] Got command RPT from MCS: ref #288154
2014-02-27 00:52:35 [DEBUG   ] summary = ERROR
2014-02-27 00:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288154  13 56715  3155613 A  ERRORERROR'
2014-02-27 00:52:35 [DEBUG   ] Got command RPT from MCS: ref #288155
2014-02-27 00:52:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 00:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288155  77 56715  3155614 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 00:52:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 00:53:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 00:53:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:53:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:53:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:53:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:53:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:53:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:53:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:53:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:53:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:53:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:53:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 00:53:13 [DEBUG   ] Finished updating board flags in 1.356 seconds
2014-02-27 00:53:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 00:53:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 00:54:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 00:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:54:14 [DEBUG   ] Finished updating board flags in 2.082 seconds
2014-02-27 00:54:28 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 00:54:48 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 00:55:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 00:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:55:14 [DEBUG   ] Finished updating board flags in 1.967 seconds
2014-02-27 00:55:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 00:55:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 00:56:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 00:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:56:14 [DEBUG   ] Finished updating board flags in 1.886 seconds
2014-02-27 00:56:28 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-02-27 00:56:48 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-27 00:57:08 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-02-27 00:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:57:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2014-02-27 00:57:14 [DEBUG   ] Finished updating board flags in 1.720 seconds
2014-02-27 00:57:29 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-02-27 00:57:35 [DEBUG   ] Got command RPT from MCS: ref #288171
2014-02-27 00:57:35 [DEBUG   ] summary = ERROR
2014-02-27 00:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288171  13 56715  3455609 A  ERRORERROR'
2014-02-27 00:57:35 [DEBUG   ] Got command RPT from MCS: ref #288172
2014-02-27 00:57:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 00:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288172  77 56715  3455610 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 00:57:49 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-27 00:58:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 00:58:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:58:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:58:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:58:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:58:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:58:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:58:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:58:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:58:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:58:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:58:14 [DEBUG   ] Finished updating board flags in 1.611 seconds
2014-02-27 00:58:29 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-02-27 00:58:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 00:59:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 00:59:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 00:59:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 00:59:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 00:59:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 00:59:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 00:59:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 00:59:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 00:59:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 00:59:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 00:59:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 00:59:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 00:59:14 [DEBUG   ] Finished updating board flags in 1.596 seconds
2014-02-27 00:59:29 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 00:59:49 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2014-02-27 01:00:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 01:00:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 01:00:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 01:00:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 01:00:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 01:00:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 01:00:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 01:00:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 01:00:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 01:00:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 01:00:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 01:00:14 [DEBUG   ] Finished updating board flags in 1.410 seconds
2014-02-27 01:00:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 01:00:49 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2014-02-27 01:01:09 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-02-27 01:01:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 01:01:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 01:01:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 01:01:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 01:01:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 01:01:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 01:01:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 01:01:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 01:01:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 01:01:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 01:01:14 [DEBUG   ] Finished updating board flags in 1.404 seconds
2014-02-27 01:01:30 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-02-27 01:01:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 01:02:00 [DEBUG   ] Got command INI from MCS: ref #288188
2014-02-27 01:02:00 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2014-02-27 01:02:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   288188   8 56715  3720370 ABOOTING'
2014-02-27 01:02:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 01:02:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 01:02:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 01:02:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 01:02:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 01:02:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 01:02:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 01:02:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 01:02:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 01:02:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 01:02:14 [DEBUG   ] Finished updating board flags in 1.410 seconds
2014-02-27 01:02:24 [INFO    ] -------------------
2014-02-27 01:02:24 [INFO    ]  LWA board status
2014-02-27 01:02:24 [INFO    ] -------------------
2014-02-27 01:02:24 [INFO    ] DP 1: 2 lwa27
2014-02-27 01:02:24 [INFO    ] DP 1: 3 lwa24
2014-02-27 01:02:24 [INFO    ] DP 1: 4 lwa23
2014-02-27 01:02:24 [INFO    ] DP 1: 5 lwa18
2014-02-27 01:02:24 [INFO    ] DP 1: 6 lwa10
2014-02-27 01:02:24 [INFO    ] DP 1: 7 lwa32
2014-02-27 01:02:24 [INFO    ] DP 1: 8 lwa11
2014-02-27 01:02:24 [INFO    ] DP 1: 9 lwa30
2014-02-27 01:02:24 [INFO    ] DP 1: 10 lwa12
2014-02-27 01:02:24 [INFO    ] DP 1: 11 lwa8
2014-02-27 01:02:24 [INFO    ] DP 1: 12 lwa13
2014-02-27 01:02:24 [INFO    ] DP 1: 13 lwa26
2014-02-27 01:02:24 [INFO    ] DP 1: 14 lwa14
2014-02-27 01:02:24 [INFO    ] DP 1: 16 lwa22
2014-02-27 01:02:24 [INFO    ] DP 1: 17 lwa20
2014-02-27 01:02:24 [INFO    ] DP 1: 18 lwa1
2014-02-27 01:02:24 [INFO    ] DP 1: 19 lwa5
2014-02-27 01:02:24 [INFO    ] DP 1: 20 lwa25
2014-02-27 01:02:24 [INFO    ] DP 1: 21 lwa35
2014-02-27 01:02:24 [INFO    ] DP 1: 22 lwa19
2014-02-27 01:02:24 [INFO    ] DP 1: 23 lwa21
2014-02-27 01:02:24 [INFO    ] DP 1: 24 lwa6
2014-02-27 01:02:24 [INFO    ] DP 1: 25 lwa7
2014-02-27 01:02:24 [INFO    ] DP 1: 26 lwa33
2014-02-27 01:02:24 [INFO    ] DP 1: 27 lwa15
2014-02-27 01:02:24 [INFO    ] DP 1: 28 lwa28
2014-02-27 01:02:24 [INFO    ] DP 2: 1 lwa16
2014-02-27 01:02:24 [INFO    ] DP 2: 15 lwa34
2014-02-27 01:02:24 [INFO    ] Total of 28 boards
2014-02-27 01:02:24 [INFO    ] Total of 260 stands
2014-02-27 01:02:24 [INFO    ] -------------------
2014-02-27 01:02:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2014-02-27 01:02:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2014-02-27 01:02:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2014-02-27 01:02:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2014-02-27 01:02:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2014-02-27 01:02:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2014-02-27 01:02:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2014-02-27 01:02:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2014-02-27 01:02:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2014-02-27 01:02:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2014-02-27 01:02:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2014-02-27 01:02:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2014-02-27 01:02:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2014-02-27 01:02:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2014-02-27 01:02:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2014-02-27 01:02:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2014-02-27 01:02:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2014-02-27 01:02:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2014-02-27 01:02:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2014-02-27 01:02:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2014-02-27 01:02:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2014-02-27 01:02:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2014-02-27 01:02:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2014-02-27 01:02:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2014-02-27 01:02:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2014-02-27 01:02:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2014-02-27 01:02:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2014-02-27 01:02:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2014-02-27 01:02:31 [DEBUG   ] 2014-02-27 01:02:31 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7342
2014-02-27 01:02:31 [DEBUG   ] 2014-02-27 01:02:31 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7343
2014-02-27 01:02:31 [DEBUG   ] 2014-02-27 01:02:31 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7344
2014-02-27 01:02:31 [DEBUG   ] 2014-02-27 01:02:31 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7345
2014-02-27 01:02:31 [DEBUG   ] 2014-02-27 01:02:31 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7346
2014-02-27 01:02:31 [DEBUG   ] 2014-02-27 01:02:31 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7347
2014-02-27 01:02:31 [DEBUG   ] 2014-02-27 01:02:31 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7348
2014-02-27 01:02:31 [DEBUG   ] 2014-02-27 01:02:31 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7349
2014-02-27 01:02:31 [DEBUG   ] 2014-02-27 01:02:31 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7350
2014-02-27 01:02:31 [DEBUG   ] 2014-02-27 01:02:31 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7351
2014-02-27 01:02:31 [DEBUG   ] 2014-02-27 01:02:31 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7352
2014-02-27 01:02:31 [DEBUG   ] 2014-02-27 01:02:31 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7353
2014-02-27 01:02:31 [DEBUG   ] 2014-02-27 01:02:31 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7354
2014-02-27 01:02:31 [DEBUG   ] 2014-02-27 01:02:31 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7355
2014-02-27 01:02:31 [DEBUG   ] 2014-02-27 01:02:31 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7356
2014-02-27 01:02:31 [DEBUG   ] 2014-02-27 01:02:31 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7357
2014-02-27 01:02:31 [DEBUG   ] 2014-02-27 01:02:31 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7358
2014-02-27 01:02:31 [DEBUG   ] 2014-02-27 01:02:31 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7359
2014-02-27 01:02:31 [DEBUG   ] 2014-02-27 01:02:31 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7360
2014-02-27 01:02:31 [DEBUG   ] 2014-02-27 01:02:31 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7361
2014-02-27 01:02:31 [DEBUG   ] 2014-02-27 01:02:31 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7362
2014-02-27 01:02:31 [DEBUG   ] 2014-02-27 01:02:31 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7363
2014-02-27 01:02:31 [DEBUG   ] 2014-02-27 01:02:31 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7364
2014-02-27 01:02:31 [DEBUG   ] 2014-02-27 01:02:31 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7365
2014-02-27 01:02:31 [DEBUG   ] 2014-02-27 01:02:31 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7366
2014-02-27 01:02:31 [DEBUG   ] 2014-02-27 01:02:31 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7367
2014-02-27 01:02:35 [DEBUG   ] Got command RPT from MCS: ref #288189
2014-02-27 01:02:35 [DEBUG   ] summary = BOOTING
2014-02-27 01:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288189  15 56715  3755613 ABOOTINGBOOTING'
2014-02-27 01:02:35 [DEBUG   ] Got command RPT from MCS: ref #288190
2014-02-27 01:02:35 [DEBUG   ] info = Running INI sequence
2014-02-27 01:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288190  28 56715  3755614 ABOOTINGRunning INI sequence'
2014-02-27 01:02:43 [DEBUG   ] 2014-02-27 01:02:43 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7342 exited with status 0
2014-02-27 01:02:43 [DEBUG   ] 2014-02-27 01:02:43 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7343 exited with status 0
2014-02-27 01:02:43 [DEBUG   ] 2014-02-27 01:02:43 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7344 exited with status 0
2014-02-27 01:02:43 [DEBUG   ] 2014-02-27 01:02:43 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7345 exited with status 0
2014-02-27 01:02:43 [DEBUG   ] 2014-02-27 01:02:43 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7346 exited with status 0
2014-02-27 01:02:44 [DEBUG   ] 2014-02-27 01:02:44 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7347 exited with status 0
2014-02-27 01:02:44 [DEBUG   ] 2014-02-27 01:02:44 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7348 exited with status 0
2014-02-27 01:02:44 [DEBUG   ] 2014-02-27 01:02:44 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7349 exited with status 0
2014-02-27 01:02:44 [DEBUG   ] 2014-02-27 01:02:44 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7350 exited with status 0
2014-02-27 01:02:44 [DEBUG   ] 2014-02-27 01:02:44 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7351 exited with status 0
2014-02-27 01:02:44 [DEBUG   ] 2014-02-27 01:02:44 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7352 exited with status 0
2014-02-27 01:02:44 [DEBUG   ] 2014-02-27 01:02:44 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7353 exited with status 0
2014-02-27 01:02:44 [DEBUG   ] 2014-02-27 01:02:44 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7354 exited with status 0
2014-02-27 01:02:44 [DEBUG   ] 2014-02-27 01:02:44 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7355 exited with status 0
2014-02-27 01:02:44 [DEBUG   ] 2014-02-27 01:02:44 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7356 exited with status 0
2014-02-27 01:02:44 [DEBUG   ] 2014-02-27 01:02:44 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7357 exited with status 0
2014-02-27 01:02:44 [DEBUG   ] 2014-02-27 01:02:44 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7358 exited with status 0
2014-02-27 01:02:44 [DEBUG   ] 2014-02-27 01:02:44 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7359 exited with status 0
2014-02-27 01:02:44 [DEBUG   ] 2014-02-27 01:02:44 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7360 exited with status 0
2014-02-27 01:02:44 [DEBUG   ] 2014-02-27 01:02:44 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7361 exited with status 0
2014-02-27 01:02:44 [DEBUG   ] 2014-02-27 01:02:44 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7362 exited with status 0
2014-02-27 01:02:44 [DEBUG   ] 2014-02-27 01:02:44 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7363 exited with status 0
2014-02-27 01:02:44 [DEBUG   ] 2014-02-27 01:02:44 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7364 exited with status 0
2014-02-27 01:02:44 [DEBUG   ] 2014-02-27 01:02:44 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7365 exited with status 0
2014-02-27 01:02:44 [DEBUG   ] 2014-02-27 01:02:44 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7366 exited with status 0
2014-02-27 01:02:44 [DEBUG   ] 2014-02-27 01:02:44 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7367 exited with status 0
2014-02-27 01:02:44 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2014-02-27 01:02:44 [DEBUG   ] spawn_process: at 2014-02-27 01:02:44 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2014-02-27 01:02:44 [DEBUG   ] spawn_process: at 2014-02-27 01:02:44 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2014-02-27 01:02:44 [DEBUG   ] spawn_process: at 2014-02-27 01:02:44 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2014-02-27 01:02:44 [DEBUG   ] spawn_process: at 2014-02-27 01:02:44 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2014-02-27 01:02:44 [DEBUG   ] spawn_process: at 2014-02-27 01:02:44 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2014-02-27 01:02:44 [DEBUG   ] spawn_process: at 2014-02-27 01:02:44 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2014-02-27 01:02:44 [DEBUG   ] spawn_process: at 2014-02-27 01:02:44 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2014-02-27 01:02:44 [DEBUG   ] spawn_process: at 2014-02-27 01:02:44 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2014-02-27 01:02:44 [DEBUG   ] spawn_process: at 2014-02-27 01:02:44 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2014-02-27 01:02:44 [DEBUG   ] spawn_process: at 2014-02-27 01:02:44 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2014-02-27 01:02:44 [DEBUG   ] spawn_process: at 2014-02-27 01:02:44 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2014-02-27 01:02:44 [DEBUG   ] spawn_process: at 2014-02-27 01:02:44 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2014-02-27 01:02:44 [DEBUG   ] spawn_process: at 2014-02-27 01:02:44 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2014-02-27 01:02:44 [DEBUG   ] spawn_process: at 2014-02-27 01:02:44 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2014-02-27 01:02:44 [DEBUG   ] spawn_process: at 2014-02-27 01:02:44 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2014-02-27 01:02:44 [DEBUG   ] spawn_process: at 2014-02-27 01:02:44 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2014-02-27 01:02:44 [DEBUG   ] spawn_process: at 2014-02-27 01:02:44 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2014-02-27 01:02:44 [DEBUG   ] spawn_process: at 2014-02-27 01:02:44 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2014-02-27 01:02:44 [DEBUG   ] spawn_process: at 2014-02-27 01:02:44 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2014-02-27 01:02:44 [DEBUG   ] spawn_process: at 2014-02-27 01:02:44 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2014-02-27 01:02:44 [DEBUG   ] spawn_process: at 2014-02-27 01:02:44 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2014-02-27 01:02:44 [DEBUG   ] spawn_process: at 2014-02-27 01:02:44 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2014-02-27 01:02:44 [DEBUG   ] spawn_process: at 2014-02-27 01:02:44 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2014-02-27 01:02:44 [DEBUG   ] spawn_process: at 2014-02-27 01:02:44 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2014-02-27 01:02:44 [DEBUG   ] spawn_process: at 2014-02-27 01:02:44 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2014-02-27 01:02:44 [DEBUG   ] spawn_process: at 2014-02-27 01:02:44 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2014-02-27 01:02:44 [DEBUG   ] 2014-02-27 01:02:44 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 7394
2014-02-27 01:02:44 [DEBUG   ] 2014-02-27 01:02:44 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 7395
2014-02-27 01:02:49 [DEBUG   ] 2014-02-27 01:02:49 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 7394 exited with status 0
2014-02-27 01:02:49 [DEBUG   ] 2014-02-27 01:02:49 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 7395 exited with status 0
2014-02-27 01:02:49 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2014-02-27 01:02:49 [DEBUG   ] spawn_process: at 2014-02-27 01:02:49 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2014-02-27 01:02:49 [DEBUG   ] spawn_process: at 2014-02-27 01:02:49 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2014-02-27 01:02:49 [INFO    ] Setting Beam 1 xbars
2014-02-27 01:02:49 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2014-02-27 01:02:49 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2014-02-27 01:02:49 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2014-02-27 01:02:50 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2014-02-27 01:02:50 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2014-02-27 01:02:50 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2014-02-27 01:02:50 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2014-02-27 01:02:50 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2014-02-27 01:02:50 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2014-02-27 01:02:50 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2014-02-27 01:02:50 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2014-02-27 01:02:50 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2014-02-27 01:02:50 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2014-02-27 01:02:51 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2014-02-27 01:02:51 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2014-02-27 01:02:51 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2014-02-27 01:02:51 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2014-02-27 01:02:51 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2014-02-27 01:02:51 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2014-02-27 01:02:51 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2014-02-27 01:02:51 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2014-02-27 01:02:51 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2014-02-27 01:02:52 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2014-02-27 01:02:52 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2014-02-27 01:02:52 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2014-02-27 01:02:52 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2014-02-27 01:02:52 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2014-02-27 01:02:52 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2014-02-27 01:02:52 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2014-02-27 01:02:52 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2014-02-27 01:02:52 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2014-02-27 01:02:53 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2014-02-27 01:02:53 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2014-02-27 01:02:53 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2014-02-27 01:02:53 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2014-02-27 01:02:53 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2014-02-27 01:02:53 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2014-02-27 01:02:53 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2014-02-27 01:02:53 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2014-02-27 01:02:53 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2014-02-27 01:02:54 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2014-02-27 01:02:54 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2014-02-27 01:02:54 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2014-02-27 01:02:54 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2014-02-27 01:02:54 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2014-02-27 01:02:54 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2014-02-27 01:02:54 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2014-02-27 01:02:54 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2014-02-27 01:02:54 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2014-02-27 01:02:55 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2014-02-27 01:02:55 [INFO    ] Setting Beam 2 xbars
2014-02-27 01:02:55 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2014-02-27 01:02:55 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2014-02-27 01:02:55 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2014-02-27 01:02:55 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2014-02-27 01:02:55 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2014-02-27 01:02:55 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2014-02-27 01:02:55 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2014-02-27 01:02:55 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2014-02-27 01:02:55 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2014-02-27 01:02:56 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2014-02-27 01:02:56 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2014-02-27 01:02:56 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2014-02-27 01:02:56 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2014-02-27 01:02:56 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2014-02-27 01:02:56 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2014-02-27 01:02:56 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2014-02-27 01:02:56 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2014-02-27 01:02:56 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2014-02-27 01:02:57 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2014-02-27 01:02:57 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2014-02-27 01:02:57 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2014-02-27 01:02:57 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2014-02-27 01:02:57 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2014-02-27 01:02:57 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2014-02-27 01:02:57 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2014-02-27 01:02:57 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2014-02-27 01:02:57 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2014-02-27 01:02:58 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2014-02-27 01:02:58 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2014-02-27 01:02:58 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2014-02-27 01:02:58 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2014-02-27 01:02:58 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2014-02-27 01:02:58 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2014-02-27 01:02:58 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2014-02-27 01:02:58 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2014-02-27 01:02:58 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2014-02-27 01:02:58 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2014-02-27 01:02:59 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2014-02-27 01:02:59 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2014-02-27 01:02:59 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2014-02-27 01:02:59 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2014-02-27 01:02:59 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2014-02-27 01:02:59 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2014-02-27 01:02:59 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2014-02-27 01:02:59 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2014-02-27 01:03:00 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2014-02-27 01:03:00 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2014-02-27 01:03:00 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2014-02-27 01:03:00 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2014-02-27 01:03:00 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2014-02-27 01:03:00 [INFO    ] Setting Beam 3 xbars
2014-02-27 01:03:00 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2014-02-27 01:03:00 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2014-02-27 01:03:00 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2014-02-27 01:03:00 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2014-02-27 01:03:01 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2014-02-27 01:03:01 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2014-02-27 01:03:01 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2014-02-27 01:03:01 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2014-02-27 01:03:01 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2014-02-27 01:03:01 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2014-02-27 01:03:01 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2014-02-27 01:03:01 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2014-02-27 01:03:01 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2014-02-27 01:03:02 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2014-02-27 01:03:02 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2014-02-27 01:03:02 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2014-02-27 01:03:02 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2014-02-27 01:03:02 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2014-02-27 01:03:02 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2014-02-27 01:03:02 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2014-02-27 01:03:02 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2014-02-27 01:03:02 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2014-02-27 01:03:02 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2014-02-27 01:03:03 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2014-02-27 01:03:03 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2014-02-27 01:03:03 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2014-02-27 01:03:03 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2014-02-27 01:03:03 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2014-02-27 01:03:03 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2014-02-27 01:03:03 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2014-02-27 01:03:03 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2014-02-27 01:03:03 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2014-02-27 01:03:04 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2014-02-27 01:03:04 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2014-02-27 01:03:04 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2014-02-27 01:03:04 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2014-02-27 01:03:04 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2014-02-27 01:03:04 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2014-02-27 01:03:04 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2014-02-27 01:03:04 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2014-02-27 01:03:04 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2014-02-27 01:03:05 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2014-02-27 01:03:05 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2014-02-27 01:03:05 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2014-02-27 01:03:05 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2014-02-27 01:03:05 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2014-02-27 01:03:05 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2014-02-27 01:03:05 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2014-02-27 01:03:05 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2014-02-27 01:03:05 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2014-02-27 01:03:06 [INFO    ] Setting Beam 4 xbars
2014-02-27 01:03:06 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2014-02-27 01:03:06 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2014-02-27 01:03:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2014-02-27 01:03:06 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2014-02-27 01:03:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2014-02-27 01:03:06 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2014-02-27 01:03:06 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2014-02-27 01:03:06 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2014-02-27 01:03:06 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2014-02-27 01:03:07 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2014-02-27 01:03:07 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2014-02-27 01:03:07 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2014-02-27 01:03:07 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2014-02-27 01:03:07 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2014-02-27 01:03:07 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2014-02-27 01:03:07 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2014-02-27 01:03:07 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2014-02-27 01:03:07 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2014-02-27 01:03:07 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2014-02-27 01:03:08 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2014-02-27 01:03:08 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2014-02-27 01:03:08 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2014-02-27 01:03:08 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2014-02-27 01:03:08 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2014-02-27 01:03:08 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2014-02-27 01:03:08 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2014-02-27 01:03:08 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2014-02-27 01:03:08 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2014-02-27 01:03:09 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2014-02-27 01:03:09 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2014-02-27 01:03:09 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2014-02-27 01:03:09 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2014-02-27 01:03:09 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2014-02-27 01:03:09 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2014-02-27 01:03:09 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2014-02-27 01:03:09 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2014-02-27 01:03:09 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2014-02-27 01:03:10 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2014-02-27 01:03:10 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2014-02-27 01:03:10 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2014-02-27 01:03:10 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2014-02-27 01:03:10 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2014-02-27 01:03:10 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2014-02-27 01:03:10 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2014-02-27 01:03:10 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2014-02-27 01:03:10 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2014-02-27 01:03:10 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2014-02-27 01:03:11 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2014-02-27 01:03:11 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2014-02-27 01:03:11 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2014-02-27 01:03:11 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2014-02-27 01:03:11 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2014-02-27 01:03:11 [INFO    ] All xbars set
2014-02-27 01:03:11 [INFO    ] Setting adder chain routing for all beams
2014-02-27 01:03:16 [INFO    ] Setting beam ids
2014-02-27 01:03:26 [INFO    ] Starting beam delay calibration
2014-02-27 01:03:38 [INFO    ] Beam 1 latency is 5744
2014-02-27 01:03:38 [INFO    ] Beam 2 latency is 5757
2014-02-27 01:03:38 [INFO    ] Beam 3 latency is 5743
2014-02-27 01:03:38 [INFO    ] Beam 4 latency is 5727
2014-02-27 01:03:38 [INFO    ] Stop calibration
2014-02-27 01:03:46 [INFO    ] Beam delay calibration successful
2014-02-27 01:03:46 [INFO    ] Calibration passed
2014-02-27 01:03:46 [DEBUG   ] spawn_process: at 2014-02-27 01:03:46 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2014-02-27 01:03:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2014-02-27 01:03:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2014-02-27 01:03:46 [DEBUG   ] spawn_process: at 2014-02-27 01:03:46 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2014-02-27 01:03:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2014-02-27 01:03:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2014-02-27 01:03:46 [DEBUG   ] spawn_process: at 2014-02-27 01:03:46 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2014-02-27 01:03:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2014-02-27 01:03:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2014-02-27 01:03:46 [DEBUG   ] spawn_process: at 2014-02-27 01:03:46 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2014-02-27 01:03:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2014-02-27 01:03:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2014-02-27 01:03:46 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2014-02-27 01:03:47 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 284 ms (1393463027.287 s) with PID 8972 and time 1393463028
2014-02-27 01:03:47 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2014-02-27 01:03:47 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 372 ms (1393463027.374 s) with PID 8975 and time 1393463028
2014-02-27 01:03:48 [DEBUG   ] Finished updating ant stats in 0.873 seconds
2014-02-27 01:03:48 [INFO    ] Started antennas statistics background thread
2014-02-27 01:03:48 [INFO    ] Started board flags background thread
2014-02-27 01:03:48 [INFO    ] Started BAM background thread
2014-02-27 01:03:48 [INFO    ] Finished the INI process (ref. #288188) in 108.128 s
2014-02-27 01:03:49 [DEBUG   ] Finished updating board flags in 1.048 seconds
2014-02-27 01:04:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 01:04:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 01:04:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 01:04:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 01:04:49 [DEBUG   ] Finished updating board flags in 1.009 seconds
2014-02-27 01:05:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 01:05:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 01:05:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 01:05:49 [DEBUG   ] Finished updating board flags in 1.069 seconds
2014-02-27 01:06:08 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-02-27 01:06:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 01:06:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 01:06:50 [DEBUG   ] Finished updating board flags in 2.001 seconds
2014-02-27 01:07:00 [DEBUG   ] Got command RPT from MCS: ref #288206
2014-02-27 01:07:00 [DEBUG   ] summary = NORMAL
2014-02-27 01:07:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288206  14 56715  4020377 A NORMALNORMAL'
2014-02-27 01:07:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 01:07:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 01:07:35 [DEBUG   ] Got command RPT from MCS: ref #288207
2014-02-27 01:07:35 [DEBUG   ] summary = NORMAL
2014-02-27 01:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288207  14 56715  4055609 A NORMALNORMAL'
2014-02-27 01:07:35 [DEBUG   ] Got command RPT from MCS: ref #288208
2014-02-27 01:07:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 01:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288208  48 56715  4055610 A NORMALSystem calibrated and operating normally'
2014-02-27 01:07:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 01:07:49 [DEBUG   ] Finished updating board flags in 1.366 seconds
2014-02-27 01:08:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 01:08:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 01:08:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 01:08:49 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-27 01:08:49 [DEBUG   ] Finished updating board flags in 1.248 seconds
2014-02-27 01:09:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 01:09:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 01:09:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 01:09:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-02-27 01:09:49 [DEBUG   ] Finished updating board flags in 1.150 seconds
2014-02-27 01:10:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 01:10:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 01:10:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 01:10:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 01:10:49 [DEBUG   ] Finished updating board flags in 1.043 seconds
2014-02-27 01:11:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 01:11:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 01:11:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 01:11:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 01:11:50 [DEBUG   ] Finished updating board flags in 1.604 seconds
2014-02-27 01:12:08 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-02-27 01:12:28 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 01:12:35 [DEBUG   ] Got command RPT from MCS: ref #288224
2014-02-27 01:12:35 [DEBUG   ] summary = NORMAL
2014-02-27 01:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288224  14 56715  4355618 A NORMALNORMAL'
2014-02-27 01:12:35 [DEBUG   ] Got command RPT from MCS: ref #288225
2014-02-27 01:12:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 01:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288225  48 56715  4355618 A NORMALSystem calibrated and operating normally'
2014-02-27 01:12:48 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 01:12:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 01:12:49 [DEBUG   ] Finished updating board flags in 0.959 seconds
2014-02-27 01:13:08 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 01:13:28 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 01:13:48 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 01:13:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-27 01:13:50 [DEBUG   ] Finished updating board flags in 1.370 seconds
2014-02-27 01:14:08 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 01:14:28 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 01:14:48 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 01:14:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 01:14:50 [DEBUG   ] Finished updating board flags in 1.210 seconds
2014-02-27 01:14:58 [DEBUG   ] Got command DRX from MCS: ref #288244
2014-02-27 01:14:58 [INFO    ] sending drx command to lwa34
2014-02-27 01:14:58 [DEBUG   ] run_process: at 2014-02-27 01:14:58 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 45450000.0 7 9 0']
2014-02-27 01:14:58 [DEBUG   ] drx = exited with status True, code 0x00
2014-02-27 01:14:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   288244   8 56715  4498006 A NORMAL'
2014-02-27 01:14:58 [DEBUG   ] Got command DRX from MCS: ref #288245
2014-02-27 01:14:58 [INFO    ] sending drx command to lwa16
2014-02-27 01:14:58 [DEBUG   ] run_process: at 2014-02-27 01:14:58 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 45450000.0 7 9 0']
2014-02-27 01:14:58 [DEBUG   ] drx = exited with status True, code 0x00
2014-02-27 01:14:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   288245   8 56715  4498010 A NORMAL'
2014-02-27 01:14:58 [DEBUG   ] Got command DRX from MCS: ref #288246
2014-02-27 01:14:58 [INFO    ] sending drx command to lwa16
2014-02-27 01:14:58 [DEBUG   ] run_process: at 2014-02-27 01:14:58 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 1 45450000.0 7 9 0']
2014-02-27 01:14:58 [DEBUG   ] drx = exited with status True, code 0x00
2014-02-27 01:14:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   288246   8 56715  4498014 A NORMAL'
2014-02-27 01:14:58 [INFO    ] Finished starting DRX
2014-02-27 01:14:58 [INFO    ] Finished starting DRX
2014-02-27 01:14:58 [INFO    ] Finished starting DRX
2014-02-27 01:14:58 [DEBUG   ] Got command DRX from MCS: ref #288247
2014-02-27 01:14:58 [INFO    ] sending drx command to lwa34
2014-02-27 01:14:58 [DEBUG   ] run_process: at 2014-02-27 01:14:58 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 65050000.0 7 9 0']
2014-02-27 01:14:58 [DEBUG   ] drx = exited with status True, code 0x00
2014-02-27 01:14:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   288247   8 56715  4498150 A NORMAL'
2014-02-27 01:14:58 [INFO    ] Finished starting DRX
2014-02-27 01:14:58 [DEBUG   ] Got command DRX from MCS: ref #288248
2014-02-27 01:14:58 [INFO    ] sending drx command to lwa16
2014-02-27 01:14:58 [DEBUG   ] run_process: at 2014-02-27 01:14:58 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 65050000.0 7 9 0']
2014-02-27 01:14:58 [DEBUG   ] drx = exited with status True, code 0x00
2014-02-27 01:14:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   288248   8 56715  4498250 A NORMAL'
2014-02-27 01:14:58 [INFO    ] Finished starting DRX
2014-02-27 01:14:58 [DEBUG   ] Got command DRX from MCS: ref #288249
2014-02-27 01:14:58 [INFO    ] sending drx command to lwa16
2014-02-27 01:14:58 [DEBUG   ] run_process: at 2014-02-27 01:14:58 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 2 65050000.0 7 9 0']
2014-02-27 01:14:58 [DEBUG   ] drx = exited with status True, code 0x00
2014-02-27 01:14:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   288249   8 56715  4498338 A NORMAL'
2014-02-27 01:14:58 [INFO    ] Finished starting DRX
2014-02-27 01:14:58 [DEBUG   ] Got command BAM from MCS: ref #288250
2014-02-27 01:14:58 [INFO    ] Finished processing BAM request
2014-02-27 01:14:58 [DEBUG   ] bam = exited with status True, code 0x00
2014-02-27 01:14:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   288250   8 56715  4498461 A NORMAL'
2014-02-27 01:14:58 [DEBUG   ] Got command BAM from MCS: ref #288251
2014-02-27 01:14:58 [INFO    ] Finished processing BAM request
2014-02-27 01:14:58 [DEBUG   ] bam = exited with status True, code 0x00
2014-02-27 01:14:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   288251   8 56715  4498561 A NORMAL'
2014-02-27 01:14:58 [DEBUG   ] Got command BAM from MCS: ref #288252
2014-02-27 01:14:58 [INFO    ] Finished processing BAM request
2014-02-27 01:14:58 [DEBUG   ] bam = exited with status True, code 0x00
2014-02-27 01:14:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   288252   8 56715  4498661 A NORMAL'
2014-02-27 01:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2014-02-27 01:14:58 [DEBUG   ] spawn_process: at 2014-02-27 01:14:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2014-02-27 01:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2014-02-27 01:14:58 [DEBUG   ] spawn_process: at 2014-02-27 01:14:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2014-02-27 01:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2014-02-27 01:14:58 [DEBUG   ] spawn_process: at 2014-02-27 01:14:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2014-02-27 01:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2014-02-27 01:14:58 [DEBUG   ] spawn_process: at 2014-02-27 01:14:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2014-02-27 01:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2014-02-27 01:14:58 [DEBUG   ] spawn_process: at 2014-02-27 01:14:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2014-02-27 01:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2014-02-27 01:14:58 [DEBUG   ] spawn_process: at 2014-02-27 01:14:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2014-02-27 01:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2014-02-27 01:14:58 [DEBUG   ] spawn_process: at 2014-02-27 01:14:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2014-02-27 01:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2014-02-27 01:14:58 [DEBUG   ] spawn_process: at 2014-02-27 01:14:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2014-02-27 01:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2014-02-27 01:14:58 [DEBUG   ] spawn_process: at 2014-02-27 01:14:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2014-02-27 01:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2014-02-27 01:14:58 [DEBUG   ] spawn_process: at 2014-02-27 01:14:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2014-02-27 01:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2014-02-27 01:14:58 [DEBUG   ] spawn_process: at 2014-02-27 01:14:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2014-02-27 01:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2014-02-27 01:14:58 [DEBUG   ] spawn_process: at 2014-02-27 01:14:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2014-02-27 01:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2014-02-27 01:14:58 [DEBUG   ] spawn_process: at 2014-02-27 01:14:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2014-02-27 01:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2014-02-27 01:14:58 [DEBUG   ] spawn_process: at 2014-02-27 01:14:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2014-02-27 01:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2014-02-27 01:14:58 [DEBUG   ] spawn_process: at 2014-02-27 01:14:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2014-02-27 01:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2014-02-27 01:14:58 [DEBUG   ] spawn_process: at 2014-02-27 01:14:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2014-02-27 01:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2014-02-27 01:14:58 [DEBUG   ] spawn_process: at 2014-02-27 01:14:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2014-02-27 01:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2014-02-27 01:14:58 [DEBUG   ] spawn_process: at 2014-02-27 01:14:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2014-02-27 01:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2014-02-27 01:14:58 [DEBUG   ] spawn_process: at 2014-02-27 01:14:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2014-02-27 01:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2014-02-27 01:14:58 [DEBUG   ] spawn_process: at 2014-02-27 01:14:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2014-02-27 01:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2014-02-27 01:14:58 [DEBUG   ] spawn_process: at 2014-02-27 01:14:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2014-02-27 01:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2014-02-27 01:14:58 [DEBUG   ] spawn_process: at 2014-02-27 01:14:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2014-02-27 01:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2014-02-27 01:14:58 [DEBUG   ] spawn_process: at 2014-02-27 01:14:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2014-02-27 01:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2014-02-27 01:14:58 [DEBUG   ] spawn_process: at 2014-02-27 01:14:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2014-02-27 01:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2014-02-27 01:14:58 [DEBUG   ] spawn_process: at 2014-02-27 01:14:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2014-02-27 01:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2014-02-27 01:14:58 [DEBUG   ] spawn_process: at 2014-02-27 01:14:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2014-02-27 01:15:08 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2014-02-27 01:15:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 01:15:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 01:15:49 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 01:15:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 01:15:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 01:15:50 [DEBUG   ] Finished updating board flags in 1.182 seconds
2014-02-27 01:16:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 01:16:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 01:16:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 01:16:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 01:16:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-27 01:16:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 01:16:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 01:16:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 01:16:50 [DEBUG   ] Finished updating board flags in 1.008 seconds
2014-02-27 01:17:00 [DEBUG   ] Got command TBN from MCS: ref #288256
2014-02-27 01:17:00 [DEBUG   ] spawn_process: at 2014-02-27 01:17:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '1', '1393463821']
2014-02-27 01:17:00 [DEBUG   ] spawn_process: at 2014-02-27 01:17:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '2', '1393463821']
2014-02-27 01:17:00 [DEBUG   ] tbn = exited with status True, code 0x00
2014-02-27 01:17:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   288256   8 56715  4620382 A NORMAL'
2014-02-27 01:17:00 [DEBUG   ] spawn_process: at 2014-02-27 01:17:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '3', '1393463821']
2014-02-27 01:17:00 [DEBUG   ] spawn_process: at 2014-02-27 01:17:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '4', '1393463821']
2014-02-27 01:17:00 [DEBUG   ] spawn_process: at 2014-02-27 01:17:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '5', '1393463821']
2014-02-27 01:17:00 [DEBUG   ] spawn_process: at 2014-02-27 01:17:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '6', '1393463821']
2014-02-27 01:17:00 [DEBUG   ] spawn_process: at 2014-02-27 01:17:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '7', '1393463821']
2014-02-27 01:17:00 [DEBUG   ] spawn_process: at 2014-02-27 01:17:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '8', '1393463821']
2014-02-27 01:17:00 [DEBUG   ] spawn_process: at 2014-02-27 01:17:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '9', '1393463821']
2014-02-27 01:17:00 [DEBUG   ] spawn_process: at 2014-02-27 01:17:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '10', '1393463821']
2014-02-27 01:17:00 [DEBUG   ] spawn_process: at 2014-02-27 01:17:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '11', '1393463821']
2014-02-27 01:17:00 [DEBUG   ] spawn_process: at 2014-02-27 01:17:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '12', '1393463821']
2014-02-27 01:17:00 [DEBUG   ] spawn_process: at 2014-02-27 01:17:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '13', '1393463821']
2014-02-27 01:17:00 [DEBUG   ] spawn_process: at 2014-02-27 01:17:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '14', '1393463821']
2014-02-27 01:17:00 [DEBUG   ] spawn_process: at 2014-02-27 01:17:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '15', '1393463821']
2014-02-27 01:17:00 [DEBUG   ] spawn_process: at 2014-02-27 01:17:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '16', '1393463821']
2014-02-27 01:17:00 [DEBUG   ] spawn_process: at 2014-02-27 01:17:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '17', '1393463821']
2014-02-27 01:17:00 [DEBUG   ] spawn_process: at 2014-02-27 01:17:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '18', '1393463821']
2014-02-27 01:17:00 [DEBUG   ] spawn_process: at 2014-02-27 01:17:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '19', '1393463821']
2014-02-27 01:17:00 [DEBUG   ] spawn_process: at 2014-02-27 01:17:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '20', '1393463821']
2014-02-27 01:17:00 [DEBUG   ] spawn_process: at 2014-02-27 01:17:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '21', '1393463821']
2014-02-27 01:17:00 [DEBUG   ] spawn_process: at 2014-02-27 01:17:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '22', '1393463821']
2014-02-27 01:17:00 [DEBUG   ] spawn_process: at 2014-02-27 01:17:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '23', '1393463821']
2014-02-27 01:17:00 [DEBUG   ] spawn_process: at 2014-02-27 01:17:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '24', '1393463821']
2014-02-27 01:17:00 [DEBUG   ] spawn_process: at 2014-02-27 01:17:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '25', '1393463821']
2014-02-27 01:17:00 [DEBUG   ] spawn_process: at 2014-02-27 01:17:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '26', '1393463821']
2014-02-27 01:17:00 [INFO    ] Finished spawning TBN in 0.047 s
2014-02-27 01:17:09 [DEBUG   ] Finished updating ant stats in 1.270 seconds
2014-02-27 01:17:29 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-02-27 01:17:35 [DEBUG   ] Got command RPT from MCS: ref #288257
2014-02-27 01:17:35 [DEBUG   ] summary = NORMAL
2014-02-27 01:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288257  14 56715  4655617 A NORMALNORMAL'
2014-02-27 01:17:35 [DEBUG   ] Got command RPT from MCS: ref #288258
2014-02-27 01:17:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 01:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288258  48 56715  4655618 A NORMALSystem calibrated and operating normally'
2014-02-27 01:17:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 01:17:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-02-27 01:17:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 01:17:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2014-02-27 01:17:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 01:17:50 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 01:17:50 [DEBUG   ] Finished updating board flags in 1.406 seconds
2014-02-27 01:18:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 01:18:29 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-27 01:18:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 01:18:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 01:18:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 01:18:50 [DEBUG   ] Finished updating board flags in 1.328 seconds
2014-02-27 01:19:09 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 01:19:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 01:19:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-27 01:19:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 01:19:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 01:19:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 01:19:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 01:19:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 01:19:51 [DEBUG   ] Finished updating board flags in 2.091 seconds
2014-02-27 01:20:10 [DEBUG   ] Finished updating ant stats in 1.601 seconds
2014-02-27 01:20:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 01:20:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 01:20:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-02-27 01:20:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 01:20:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 01:20:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 01:20:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 01:20:51 [DEBUG   ] Finished updating board flags in 2.009 seconds
2014-02-27 01:21:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 01:21:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 01:21:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 01:21:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 01:21:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2014-02-27 01:21:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2014-02-27 01:21:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 01:21:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-02-27 01:21:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 01:21:51 [DEBUG   ] Finished updating board flags in 2.084 seconds
2014-02-27 01:22:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 01:22:29 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 01:22:35 [DEBUG   ] Got command RPT from MCS: ref #288274
2014-02-27 01:22:35 [DEBUG   ] summary = NORMAL
2014-02-27 01:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288274  14 56715  4955621 A NORMALNORMAL'
2014-02-27 01:22:35 [DEBUG   ] Got command RPT from MCS: ref #288275
2014-02-27 01:22:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 01:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288275  48 56715  4955622 A NORMALSystem calibrated and operating normally'
2014-02-27 01:22:50 [DEBUG   ] Finished updating ant stats in 1.456 seconds
2014-02-27 01:22:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 01:22:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 01:22:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 01:22:51 [DEBUG   ] Finished updating board flags in 1.897 seconds
2014-02-27 01:23:10 [DEBUG   ] Finished updating ant stats in 1.347 seconds
2014-02-27 01:23:30 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-02-27 01:23:50 [DEBUG   ] Finished updating ant stats in 1.056 seconds
2014-02-27 01:23:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 01:23:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2014-02-27 01:23:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 01:23:51 [DEBUG   ] Finished updating board flags in 1.816 seconds
2014-02-27 01:24:10 [DEBUG   ] Finished updating ant stats in 0.948 seconds
2014-02-27 01:24:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 01:24:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 01:24:50 [DEBUG   ] Finished updating ant stats in 0.849 seconds
2014-02-27 01:24:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 01:24:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 01:24:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 01:24:51 [DEBUG   ] Finished updating board flags in 1.781 seconds
2014-02-27 01:25:10 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2014-02-27 01:25:30 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 01:25:50 [DEBUG   ] Finished updating ant stats in 0.449 seconds
2014-02-27 01:25:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 01:25:51 [DEBUG   ] Finished updating board flags in 1.620 seconds
2014-02-27 01:26:11 [DEBUG   ] Finished updating ant stats in 1.355 seconds
2014-02-27 01:26:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 01:26:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 01:26:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 01:26:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2014-02-27 01:26:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 01:26:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 01:26:51 [DEBUG   ] Finished updating ant stats in 1.247 seconds
2014-02-27 01:26:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 01:26:51 [DEBUG   ] Finished updating board flags in 1.643 seconds
2014-02-27 01:27:11 [DEBUG   ] Finished updating ant stats in 1.158 seconds
2014-02-27 01:27:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 01:27:35 [DEBUG   ] Got command RPT from MCS: ref #288291
2014-02-27 01:27:35 [DEBUG   ] summary = NORMAL
2014-02-27 01:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288291  14 56715  5255621 A NORMALNORMAL'
2014-02-27 01:27:35 [DEBUG   ] Got command RPT from MCS: ref #288292
2014-02-27 01:27:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 01:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288292  48 56715  5255622 A NORMALSystem calibrated and operating normally'
2014-02-27 01:27:51 [DEBUG   ] Finished updating ant stats in 1.048 seconds
2014-02-27 01:27:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 01:27:51 [DEBUG   ] Finished updating board flags in 1.625 seconds
2014-02-27 01:28:11 [DEBUG   ] Finished updating ant stats in 0.955 seconds
2014-02-27 01:28:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 01:28:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 01:28:51 [DEBUG   ] Finished updating ant stats in 0.844 seconds
2014-02-27 01:28:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 01:28:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 01:28:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 01:28:51 [DEBUG   ] Finished updating board flags in 1.576 seconds
2014-02-27 01:29:11 [DEBUG   ] Finished updating ant stats in 0.763 seconds
2014-02-27 01:29:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 01:29:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 01:29:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 01:29:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 01:29:51 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2014-02-27 01:29:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 01:29:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 01:29:51 [DEBUG   ] Finished updating board flags in 1.453 seconds
2014-02-27 01:30:11 [DEBUG   ] Finished updating ant stats in 0.560 seconds
2014-02-27 01:30:31 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2014-02-27 01:30:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 01:30:52 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 01:30:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 01:30:52 [DEBUG   ] Finished updating board flags in 2.505 seconds
2014-02-27 01:31:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 01:31:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 01:31:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 1
2014-02-27 01:31:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 01:31:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 01:31:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 01:31:51 [DEBUG   ] Finished updating board flags in 1.396 seconds
2014-02-27 01:31:52 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 01:32:12 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2014-02-27 01:32:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 01:32:35 [DEBUG   ] Got command RPT from MCS: ref #288308
2014-02-27 01:32:35 [DEBUG   ] summary = NORMAL
2014-02-27 01:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288308  14 56715  5555617 A NORMALNORMAL'
2014-02-27 01:32:35 [DEBUG   ] Got command RPT from MCS: ref #288309
2014-02-27 01:32:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 01:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288309  48 56715  5555618 A NORMALSystem calibrated and operating normally'
2014-02-27 01:32:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2014-02-27 01:32:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 01:32:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 01:32:52 [DEBUG   ] Finished updating ant stats in 0.650 seconds
2014-02-27 01:32:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 01:32:52 [DEBUG   ] Finished updating board flags in 2.063 seconds
2014-02-27 01:33:12 [DEBUG   ] Finished updating ant stats in 0.555 seconds
2014-02-27 01:33:32 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 01:33:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 01:33:52 [DEBUG   ] Finished updating ant stats in 0.445 seconds
2014-02-27 01:33:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-02-27 01:33:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 01:33:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 01:33:52 [DEBUG   ] Finished updating board flags in 1.983 seconds
2014-02-27 01:34:13 [DEBUG   ] Finished updating ant stats in 1.357 seconds
2014-02-27 01:34:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 01:34:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 01:34:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 01:34:52 [DEBUG   ] Finished updating board flags in 1.814 seconds
2014-02-27 01:34:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 01:35:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 01:35:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 01:35:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 01:35:52 [DEBUG   ] Finished updating board flags in 1.775 seconds
2014-02-27 01:35:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 01:36:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 01:36:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 01:36:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-02-27 01:36:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 01:36:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 01:36:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 01:36:52 [DEBUG   ] Finished updating board flags in 1.638 seconds
2014-02-27 01:36:53 [DEBUG   ] Finished updating ant stats in 1.185 seconds
2014-02-27 01:37:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 01:37:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 01:37:35 [DEBUG   ] Got command RPT from MCS: ref #288325
2014-02-27 01:37:35 [DEBUG   ] summary = NORMAL
2014-02-27 01:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288325  14 56715  5855617 A NORMALNORMAL'
2014-02-27 01:37:35 [DEBUG   ] Got command RPT from MCS: ref #288326
2014-02-27 01:37:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 01:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288326  48 56715  5855618 A NORMALSystem calibrated and operating normally'
2014-02-27 01:37:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2014-02-27 01:37:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 01:37:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 01:37:52 [DEBUG   ] Finished updating board flags in 1.576 seconds
2014-02-27 01:37:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 01:38:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 01:38:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 01:38:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 01:38:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 01:38:52 [DEBUG   ] Finished updating board flags in 1.551 seconds
2014-02-27 01:38:53 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 01:39:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 01:39:33 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-02-27 01:39:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 01:39:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2014-02-27 01:39:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 01:39:53 [DEBUG   ] Finished updating board flags in 1.575 seconds
2014-02-27 01:39:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 01:40:13 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 01:40:33 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-02-27 01:40:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 01:40:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 01:40:53 [DEBUG   ] Finished updating board flags in 2.105 seconds
2014-02-27 01:40:54 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-02-27 01:41:14 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-27 01:41:34 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 01:41:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-02-27 01:41:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 01:41:53 [DEBUG   ] Finished updating board flags in 2.037 seconds
2014-02-27 01:41:54 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 01:42:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 01:42:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 01:42:35 [DEBUG   ] Got command RPT from MCS: ref #288342
2014-02-27 01:42:35 [DEBUG   ] summary = NORMAL
2014-02-27 01:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288342  14 56715  6155617 A NORMALNORMAL'
2014-02-27 01:42:35 [DEBUG   ] Got command RPT from MCS: ref #288343
2014-02-27 01:42:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 01:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288343  48 56715  6155618 A NORMALSystem calibrated and operating normally'
2014-02-27 01:42:53 [DEBUG   ] Finished updating board flags in 1.953 seconds
2014-02-27 01:42:54 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 01:43:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 01:43:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 01:43:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 01:43:53 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 01:43:53 [DEBUG   ] Finished updating board flags in 1.808 seconds
2014-02-27 01:43:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 01:44:14 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2014-02-27 01:44:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 01:44:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 01:44:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 01:44:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 01:44:53 [DEBUG   ] Finished updating board flags in 1.789 seconds
2014-02-27 01:44:54 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-02-27 01:45:14 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-02-27 01:45:34 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2014-02-27 01:45:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 01:45:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 01:45:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 01:45:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 01:45:53 [DEBUG   ] Finished updating board flags in 1.558 seconds
2014-02-27 01:45:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 01:46:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 01:46:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 01:46:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-02-27 01:46:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 01:46:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 01:46:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-02-27 01:46:53 [DEBUG   ] Finished updating board flags in 1.407 seconds
2014-02-27 01:46:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 01:47:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 01:47:35 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 01:47:35 [DEBUG   ] Got command RPT from MCS: ref #288359
2014-02-27 01:47:35 [DEBUG   ] summary = NORMAL
2014-02-27 01:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288359  14 56715  6455625 A NORMALNORMAL'
2014-02-27 01:47:35 [DEBUG   ] Got command RPT from MCS: ref #288360
2014-02-27 01:47:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 01:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288360  48 56715  6455626 A NORMALSystem calibrated and operating normally'
2014-02-27 01:47:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 01:47:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2014-02-27 01:47:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2014-02-27 01:47:53 [DEBUG   ] Finished updating board flags in 1.393 seconds
2014-02-27 01:47:55 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 01:48:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 01:48:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 01:48:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-02-27 01:48:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-27 01:48:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 01:48:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 01:48:53 [DEBUG   ] Finished updating board flags in 1.356 seconds
2014-02-27 01:48:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 01:49:15 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 01:49:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 01:49:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 01:49:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 01:49:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-27 01:49:54 [DEBUG   ] Finished updating board flags in 2.098 seconds
2014-02-27 01:49:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 01:50:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 01:50:35 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 01:50:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-02-27 01:50:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 01:50:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 01:50:54 [DEBUG   ] Finished updating board flags in 1.983 seconds
2014-02-27 01:50:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-27 01:51:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 01:51:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 01:51:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 01:51:54 [DEBUG   ] Finished updating board flags in 1.820 seconds
2014-02-27 01:51:55 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 01:52:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 01:52:35 [DEBUG   ] Got command RPT from MCS: ref #288376
2014-02-27 01:52:35 [DEBUG   ] summary = NORMAL
2014-02-27 01:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288376  14 56715  6755622 A NORMALNORMAL'
2014-02-27 01:52:35 [DEBUG   ] Got command RPT from MCS: ref #288377
2014-02-27 01:52:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 01:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288377  48 56715  6755622 A NORMALSystem calibrated and operating normally'
2014-02-27 01:52:36 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-27 01:52:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 01:52:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 01:52:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 01:52:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 01:52:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 01:52:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 01:52:54 [DEBUG   ] Finished updating board flags in 1.757 seconds
2014-02-27 01:52:56 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-27 01:53:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 01:53:36 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-02-27 01:53:54 [DEBUG   ] Finished updating board flags in 1.611 seconds
2014-02-27 01:53:56 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2014-02-27 01:54:16 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 01:54:36 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-02-27 01:54:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 01:54:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 01:54:54 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 01:54:54 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 01:54:54 [DEBUG   ] Finished updating board flags in 1.609 seconds
2014-02-27 01:54:57 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-27 01:55:16 [DEBUG   ] Finished updating ant stats in 0.408 seconds
2014-02-27 01:55:37 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-02-27 01:55:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 01:55:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 01:55:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2014-02-27 01:55:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 01:55:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 01:55:54 [DEBUG   ] Finished updating board flags in 1.589 seconds
2014-02-27 01:55:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 01:56:17 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 01:56:37 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-27 01:56:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 01:56:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 01:56:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 01:56:54 [DEBUG   ] Finished updating board flags in 1.403 seconds
2014-02-27 01:56:57 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-02-27 01:57:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 01:57:35 [DEBUG   ] Got command RPT from MCS: ref #288393
2014-02-27 01:57:35 [DEBUG   ] summary = NORMAL
2014-02-27 01:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288393  14 56715  7055626 A NORMALNORMAL'
2014-02-27 01:57:35 [DEBUG   ] Got command RPT from MCS: ref #288394
2014-02-27 01:57:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 01:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288394  48 56715  7055626 A NORMALSystem calibrated and operating normally'
2014-02-27 01:57:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 01:57:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 01:57:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 01:57:54 [DEBUG   ] Finished updating board flags in 1.393 seconds
2014-02-27 01:57:57 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-02-27 01:58:18 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-27 01:58:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 01:58:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 01:58:54 [DEBUG   ] Finished updating board flags in 1.352 seconds
2014-02-27 01:58:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 01:59:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 01:59:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 01:59:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 01:59:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2014-02-27 01:59:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 01:59:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 01:59:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 01:59:55 [DEBUG   ] Finished updating board flags in 2.118 seconds
2014-02-27 01:59:58 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 02:00:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 02:00:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 02:00:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 02:00:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 02:00:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 02:00:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 02:00:55 [DEBUG   ] Finished updating board flags in 2.008 seconds
2014-02-27 02:00:58 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-27 02:01:18 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 02:01:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 02:01:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 02:01:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2014-02-27 02:01:55 [DEBUG   ] Finished updating board flags in 1.925 seconds
2014-02-27 02:01:58 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 02:02:18 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-27 02:02:35 [DEBUG   ] Got command RPT from MCS: ref #288410
2014-02-27 02:02:35 [DEBUG   ] summary = NORMAL
2014-02-27 02:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288410  14 56715  7355629 A NORMALNORMAL'
2014-02-27 02:02:35 [DEBUG   ] Got command RPT from MCS: ref #288411
2014-02-27 02:02:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 02:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288411  48 56715  7355630 A NORMALSystem calibrated and operating normally'
2014-02-27 02:02:38 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 02:02:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 02:02:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 02:02:55 [DEBUG   ] Finished updating board flags in 1.818 seconds
2014-02-27 02:02:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 02:03:18 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-27 02:03:39 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-02-27 02:03:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 02:03:55 [DEBUG   ] Finished updating board flags in 1.783 seconds
2014-02-27 02:03:59 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-27 02:04:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 02:04:39 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 02:04:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 02:04:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 02:04:55 [DEBUG   ] Finished updating board flags in 1.621 seconds
2014-02-27 02:04:59 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 02:05:19 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-27 02:05:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 02:05:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 02:05:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 02:05:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 02:05:55 [DEBUG   ] Finished updating board flags in 1.589 seconds
2014-02-27 02:05:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 02:06:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 02:06:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 02:06:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 02:06:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 02:06:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-27 02:06:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 02:06:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 02:06:55 [DEBUG   ] Finished updating board flags in 1.413 seconds
2014-02-27 02:06:59 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 02:07:19 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2014-02-27 02:07:35 [DEBUG   ] Got command RPT from MCS: ref #288427
2014-02-27 02:07:35 [DEBUG   ] summary = NORMAL
2014-02-27 02:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288427  14 56715  7655630 A NORMALNORMAL'
2014-02-27 02:07:35 [DEBUG   ] Got command RPT from MCS: ref #288428
2014-02-27 02:07:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 02:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288428  48 56715  7655630 A NORMALSystem calibrated and operating normally'
2014-02-27 02:07:40 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-02-27 02:07:54 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 02:07:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 02:07:55 [DEBUG   ] Finished updating board flags in 1.384 seconds
2014-02-27 02:08:00 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 02:08:20 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-27 02:08:40 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 02:08:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 02:08:55 [DEBUG   ] Finished updating board flags in 1.350 seconds
2014-02-27 02:09:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 02:09:20 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 02:09:40 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 02:09:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 02:09:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 02:09:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 02:09:56 [DEBUG   ] Finished updating board flags in 2.069 seconds
2014-02-27 02:10:00 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 02:10:20 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2014-02-27 02:10:41 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2014-02-27 02:10:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 02:10:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 02:10:56 [DEBUG   ] Finished updating board flags in 1.986 seconds
2014-02-27 02:11:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 02:11:21 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 02:11:41 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 02:11:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 02:11:56 [DEBUG   ] Finished updating board flags in 1.819 seconds
2014-02-27 02:12:01 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-27 02:12:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 02:12:35 [DEBUG   ] Got command RPT from MCS: ref #288444
2014-02-27 02:12:35 [DEBUG   ] summary = NORMAL
2014-02-27 02:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288444  14 56715  7955633 A NORMALNORMAL'
2014-02-27 02:12:35 [DEBUG   ] Got command RPT from MCS: ref #288445
2014-02-27 02:12:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 02:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288445  48 56715  7955634 A NORMALSystem calibrated and operating normally'
2014-02-27 02:12:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 02:12:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 02:12:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 02:12:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 02:12:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 02:12:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 02:12:56 [DEBUG   ] Finished updating board flags in 1.792 seconds
2014-02-27 02:13:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-27 02:13:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 02:13:41 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 02:13:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 02:13:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 02:13:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-02-27 02:13:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 02:13:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 02:13:56 [DEBUG   ] Finished updating board flags in 1.616 seconds
2014-02-27 02:14:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 02:14:21 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 02:14:41 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 02:14:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 02:14:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-02-27 02:14:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 02:14:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 02:14:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 02:14:56 [DEBUG   ] Finished updating board flags in 1.592 seconds
2014-02-27 02:15:01 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 02:15:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 02:15:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 02:15:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 02:15:56 [DEBUG   ] Finished updating board flags in 1.409 seconds
2014-02-27 02:16:01 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-27 02:16:21 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-02-27 02:16:42 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-27 02:16:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-02-27 02:16:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 02:16:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 02:16:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 02:16:56 [DEBUG   ] Finished updating board flags in 1.389 seconds
2014-02-27 02:17:01 [DEBUG   ] Finished updating ant stats in 0.476 seconds
2014-02-27 02:17:22 [DEBUG   ] Finished updating ant stats in 1.331 seconds
2014-02-27 02:17:35 [DEBUG   ] Got command RPT from MCS: ref #288461
2014-02-27 02:17:35 [DEBUG   ] summary = NORMAL
2014-02-27 02:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288461  14 56715  8255634 A NORMALNORMAL'
2014-02-27 02:17:35 [DEBUG   ] Got command RPT from MCS: ref #288462
2014-02-27 02:17:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 02:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288462  48 56715  8255634 A NORMALSystem calibrated and operating normally'
2014-02-27 02:17:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 02:17:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 02:17:56 [DEBUG   ] Finished updating board flags in 1.383 seconds
2014-02-27 02:18:02 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-27 02:18:22 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 02:18:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 02:18:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 02:18:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 02:18:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 02:18:57 [DEBUG   ] Finished updating board flags in 2.027 seconds
2014-02-27 02:19:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 02:19:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 02:19:42 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 02:19:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 4
2014-02-27 02:19:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 02:19:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 02:19:57 [DEBUG   ] Finished updating board flags in 2.048 seconds
2014-02-27 02:20:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 02:20:22 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-27 02:20:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 02:20:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 02:20:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-02-27 02:20:57 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 02:20:57 [DEBUG   ] Finished updating board flags in 2.003 seconds
2014-02-27 02:21:02 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 02:21:22 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 02:21:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 02:21:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-02-27 02:21:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 02:21:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-27 02:21:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 02:21:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 02:21:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 02:21:57 [DEBUG   ] Finished updating board flags in 1.953 seconds
2014-02-27 02:22:02 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2014-02-27 02:22:22 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 02:22:35 [DEBUG   ] Got command RPT from MCS: ref #288478
2014-02-27 02:22:35 [DEBUG   ] summary = NORMAL
2014-02-27 02:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288478  14 56715  8555634 A NORMALNORMAL'
2014-02-27 02:22:35 [DEBUG   ] Got command RPT from MCS: ref #288479
2014-02-27 02:22:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 02:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288479  48 56715  8555634 A NORMALSystem calibrated and operating normally'
2014-02-27 02:22:42 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-27 02:22:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 02:22:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 02:22:57 [DEBUG   ] Finished updating board flags in 1.808 seconds
2014-02-27 02:23:02 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-27 02:23:23 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-02-27 02:23:43 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-27 02:23:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 02:23:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 02:23:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 02:23:57 [DEBUG   ] Finished updating board flags in 1.783 seconds
2014-02-27 02:24:03 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 02:24:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-27 02:24:43 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 02:24:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 02:24:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 02:24:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 02:24:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 02:24:57 [DEBUG   ] Finished updating board flags in 1.616 seconds
2014-02-27 02:25:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 02:25:23 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2014-02-27 02:25:43 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-27 02:25:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2014-02-27 02:25:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 02:25:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 02:25:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 02:25:57 [DEBUG   ] Finished updating board flags in 1.609 seconds
2014-02-27 02:26:03 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 02:26:23 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2014-02-27 02:26:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 02:26:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 02:26:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 02:26:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 02:26:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 02:26:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 02:26:57 [DEBUG   ] Finished updating board flags in 1.581 seconds
2014-02-27 02:27:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-27 02:27:23 [DEBUG   ] Finished updating ant stats in 0.580 seconds
2014-02-27 02:27:35 [DEBUG   ] Got command RPT from MCS: ref #288495
2014-02-27 02:27:35 [DEBUG   ] summary = NORMAL
2014-02-27 02:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288495  14 56715  8855637 A NORMALNORMAL'
2014-02-27 02:27:35 [DEBUG   ] Got command RPT from MCS: ref #288496
2014-02-27 02:27:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 02:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288496  48 56715  8855638 A NORMALSystem calibrated and operating normally'
2014-02-27 02:27:44 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-02-27 02:27:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-02-27 02:27:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 02:27:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2014-02-27 02:27:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 02:27:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 02:27:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 02:27:57 [DEBUG   ] Finished updating board flags in 1.415 seconds
2014-02-27 02:28:04 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2014-02-27 02:28:24 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 02:28:44 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 02:28:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 02:28:57 [DEBUG   ] Finished updating board flags in 1.394 seconds
2014-02-27 02:29:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 02:29:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 02:29:44 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 02:29:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 02:29:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 02:29:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 02:29:57 [DEBUG   ] Finished updating board flags in 1.360 seconds
2014-02-27 02:30:04 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 02:30:24 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 02:30:44 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-27 02:30:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 02:30:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 02:30:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 02:30:58 [DEBUG   ] Finished updating board flags in 2.060 seconds
2014-02-27 02:31:04 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 02:31:24 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 02:31:45 [DEBUG   ] Finished updating ant stats in 1.405 seconds
2014-02-27 02:31:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 02:31:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 02:31:58 [DEBUG   ] Finished updating board flags in 1.995 seconds
2014-02-27 02:32:04 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2014-02-27 02:32:25 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-27 02:32:35 [DEBUG   ] Got command RPT from MCS: ref #288512
2014-02-27 02:32:35 [DEBUG   ] summary = NORMAL
2014-02-27 02:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288512  14 56715  9155633 A NORMALNORMAL'
2014-02-27 02:32:35 [DEBUG   ] Got command RPT from MCS: ref #288513
2014-02-27 02:32:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 02:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288513  48 56715  9155634 A NORMALSystem calibrated and operating normally'
2014-02-27 02:32:45 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-27 02:32:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 02:32:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 02:32:58 [DEBUG   ] Finished updating board flags in 1.810 seconds
2014-02-27 02:33:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-27 02:33:25 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 02:33:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 02:33:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-02-27 02:33:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 02:33:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 02:33:58 [DEBUG   ] Finished updating board flags in 1.780 seconds
2014-02-27 02:34:05 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-27 02:34:25 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2014-02-27 02:34:45 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 02:34:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 02:34:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 02:34:58 [DEBUG   ] Finished updating board flags in 1.603 seconds
2014-02-27 02:35:05 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 02:35:26 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-02-27 02:35:46 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-27 02:35:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 02:35:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-27 02:35:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 02:35:58 [DEBUG   ] Finished updating board flags in 1.593 seconds
2014-02-27 02:36:06 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-27 02:36:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-27 02:36:46 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 02:36:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 02:36:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 02:36:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 02:36:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 02:36:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 02:36:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-02-27 02:36:58 [DEBUG   ] Finished updating board flags in 1.421 seconds
2014-02-27 02:37:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 02:37:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 02:37:35 [DEBUG   ] Got command RPT from MCS: ref #288529
2014-02-27 02:37:35 [DEBUG   ] summary = NORMAL
2014-02-27 02:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288529  14 56715  9455637 A NORMALNORMAL'
2014-02-27 02:37:35 [DEBUG   ] Got command RPT from MCS: ref #288530
2014-02-27 02:37:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 02:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288530  48 56715  9455638 A NORMALSystem calibrated and operating normally'
2014-02-27 02:37:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 02:37:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 02:37:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 02:37:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 02:37:58 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 02:37:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 02:37:58 [DEBUG   ] Finished updating board flags in 1.386 seconds
2014-02-27 02:38:06 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2014-02-27 02:38:26 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 02:38:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 02:38:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 02:38:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 02:38:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 02:38:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 02:38:58 [DEBUG   ] Finished updating board flags in 1.362 seconds
2014-02-27 02:39:06 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-27 02:39:26 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 02:39:47 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-02-27 02:39:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 02:39:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 02:39:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 02:39:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 02:39:59 [DEBUG   ] Finished updating board flags in 2.046 seconds
2014-02-27 02:40:07 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-27 02:40:27 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 02:40:47 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 02:40:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 02:40:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 02:40:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 02:40:59 [DEBUG   ] Finished updating board flags in 2.009 seconds
2014-02-27 02:41:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 02:41:27 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-27 02:41:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 02:41:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2014-02-27 02:41:59 [DEBUG   ] Finished updating board flags in 1.983 seconds
2014-02-27 02:42:07 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 02:42:28 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-02-27 02:42:35 [DEBUG   ] Got command RPT from MCS: ref #288546
2014-02-27 02:42:35 [DEBUG   ] summary = NORMAL
2014-02-27 02:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288546  14 56715  9755641 A NORMALNORMAL'
2014-02-27 02:42:35 [DEBUG   ] Got command RPT from MCS: ref #288547
2014-02-27 02:42:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 02:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288547  48 56715  9755642 A NORMALSystem calibrated and operating normally'
2014-02-27 02:42:48 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-02-27 02:42:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 02:42:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-27 02:42:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 02:42:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-02-27 02:42:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 02:42:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2014-02-27 02:42:59 [DEBUG   ] Finished updating board flags in 1.823 seconds
2014-02-27 02:43:08 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-27 02:43:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 02:43:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-27 02:43:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 02:43:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 02:43:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-27 02:43:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2014-02-27 02:43:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 02:43:59 [DEBUG   ] Finished updating board flags in 1.786 seconds
2014-02-27 02:44:08 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 02:44:28 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 02:44:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 02:44:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 02:44:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 02:44:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 02:44:59 [DEBUG   ] Finished updating board flags in 1.612 seconds
2014-02-27 02:45:08 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2014-02-27 02:45:28 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 02:45:48 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 02:45:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 02:45:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2014-02-27 02:45:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 02:45:59 [DEBUG   ] Finished updating board flags in 1.604 seconds
2014-02-27 02:46:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 02:46:28 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-27 02:46:48 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 02:46:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 02:46:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 02:46:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 02:46:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 02:46:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 02:46:59 [DEBUG   ] Finished updating board flags in 1.585 seconds
2014-02-27 02:47:08 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 02:47:28 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-27 02:47:35 [DEBUG   ] Got command RPT from MCS: ref #288563
2014-02-27 02:47:35 [DEBUG   ] summary = NORMAL
2014-02-27 02:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288563  14 56715 10055645 A NORMALNORMAL'
2014-02-27 02:47:35 [DEBUG   ] Got command RPT from MCS: ref #288564
2014-02-27 02:47:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 02:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288564  48 56715 10055646 A NORMALSystem calibrated and operating normally'
2014-02-27 02:47:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-27 02:47:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 02:47:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 02:47:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 02:47:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 02:47:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 02:47:59 [DEBUG   ] Finished updating board flags in 1.418 seconds
2014-02-27 02:48:08 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 02:48:28 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 02:48:49 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-02-27 02:48:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 02:48:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 02:48:59 [DEBUG   ] Finished updating board flags in 1.384 seconds
2014-02-27 02:49:08 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2014-02-27 02:49:29 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-02-27 02:49:49 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2014-02-27 02:49:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 02:49:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 02:49:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 02:49:59 [DEBUG   ] Finished updating board flags in 1.361 seconds
2014-02-27 02:50:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 02:50:29 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2014-02-27 02:50:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 02:50:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2014-02-27 02:50:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 02:50:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 02:50:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 02:51:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 02:51:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-02-27 02:51:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 02:51:00 [DEBUG   ] Finished updating board flags in 2.055 seconds
2014-02-27 02:51:09 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-27 02:51:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 02:51:49 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 02:51:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2014-02-27 02:51:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 02:51:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 02:52:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 02:52:00 [DEBUG   ] Finished updating board flags in 2.022 seconds
2014-02-27 02:52:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 02:52:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 02:52:35 [DEBUG   ] Got command RPT from MCS: ref #288580
2014-02-27 02:52:35 [DEBUG   ] summary = NORMAL
2014-02-27 02:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288580  14 56715 10355641 A NORMALNORMAL'
2014-02-27 02:52:35 [DEBUG   ] Got command RPT from MCS: ref #288581
2014-02-27 02:52:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 02:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288581  48 56715 10355642 A NORMALSystem calibrated and operating normally'
2014-02-27 02:52:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 02:52:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 02:52:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 02:52:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 02:53:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 02:53:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 02:53:00 [DEBUG   ] Finished updating board flags in 2.009 seconds
2014-02-27 02:53:09 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 02:53:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 02:53:49 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-27 02:53:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2014-02-27 02:53:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-02-27 02:53:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 02:53:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 02:54:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 02:54:00 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 02:54:00 [DEBUG   ] Finished updating board flags in 1.974 seconds
2014-02-27 02:54:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-27 02:54:29 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 02:54:50 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-02-27 02:55:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 02:55:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 02:55:00 [DEBUG   ] Finished updating board flags in 1.800 seconds
2014-02-27 02:55:09 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2014-02-27 02:55:29 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2014-02-27 02:55:49 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2014-02-27 02:55:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 02:56:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 02:56:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 02:56:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 02:56:00 [DEBUG   ] Finished updating board flags in 1.667 seconds
2014-02-27 02:56:10 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-27 02:56:30 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 02:56:50 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 02:56:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 02:56:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 02:57:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 02:57:00 [DEBUG   ] Finished updating board flags in 1.619 seconds
2014-02-27 02:57:10 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-27 02:57:30 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 02:57:35 [DEBUG   ] Got command RPT from MCS: ref #288597
2014-02-27 02:57:35 [DEBUG   ] summary = NORMAL
2014-02-27 02:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288597  14 56715 10655641 A NORMALNORMAL'
2014-02-27 02:57:35 [DEBUG   ] Got command RPT from MCS: ref #288598
2014-02-27 02:57:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 02:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288598  48 56715 10655642 A NORMALSystem calibrated and operating normally'
2014-02-27 02:57:50 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 02:57:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2014-02-27 02:58:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 02:58:00 [DEBUG   ] Finished updating board flags in 1.516 seconds
2014-02-27 02:58:10 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 02:58:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 02:58:50 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2014-02-27 02:58:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 02:59:00 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 02:59:00 [DEBUG   ] Finished updating board flags in 1.421 seconds
2014-02-27 02:59:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 02:59:30 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 02:59:50 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-27 03:00:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 03:00:00 [DEBUG   ] Finished updating board flags in 1.384 seconds
2014-02-27 03:00:10 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-27 03:00:30 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 03:00:50 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2014-02-27 03:00:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 03:01:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-27 03:01:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 03:01:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 03:01:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 03:01:00 [DEBUG   ] Finished updating board flags in 1.383 seconds
2014-02-27 03:01:11 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-27 03:01:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-27 03:01:51 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 03:02:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 03:02:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 03:02:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 03:02:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 03:02:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 03:02:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 03:02:01 [DEBUG   ] Finished updating board flags in 2.026 seconds
2014-02-27 03:02:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 03:02:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 03:02:35 [DEBUG   ] Got command RPT from MCS: ref #288614
2014-02-27 03:02:35 [DEBUG   ] summary = NORMAL
2014-02-27 03:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288614  14 56715 10955649 A NORMALNORMAL'
2014-02-27 03:02:35 [DEBUG   ] Got command RPT from MCS: ref #288615
2014-02-27 03:02:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 03:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288615  48 56715 10955650 A NORMALSystem calibrated and operating normally'
2014-02-27 03:02:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 03:03:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 03:03:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 03:03:01 [DEBUG   ] Finished updating board flags in 2.008 seconds
2014-02-27 03:03:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 03:03:31 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 03:03:51 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2014-02-27 03:04:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 03:04:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 03:04:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 03:04:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 03:04:01 [DEBUG   ] Finished updating board flags in 1.989 seconds
2014-02-27 03:04:11 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 03:04:31 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 03:04:52 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-02-27 03:05:01 [DEBUG   ] Finished updating board flags in 1.821 seconds
2014-02-27 03:05:11 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2014-02-27 03:05:32 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-02-27 03:05:52 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2014-02-27 03:06:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 03:06:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 03:06:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 03:06:01 [DEBUG   ] Finished updating board flags in 1.792 seconds
2014-02-27 03:06:12 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-27 03:06:32 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 03:06:52 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 03:07:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-27 03:07:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2014-02-27 03:07:01 [DEBUG   ] Finished updating board flags in 1.613 seconds
2014-02-27 03:07:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 03:07:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 03:07:35 [DEBUG   ] Got command RPT from MCS: ref #288631
2014-02-27 03:07:35 [DEBUG   ] summary = NORMAL
2014-02-27 03:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288631  14 56715 11255649 A NORMALNORMAL'
2014-02-27 03:07:35 [DEBUG   ] Got command RPT from MCS: ref #288632
2014-02-27 03:07:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 03:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288632  48 56715 11255650 A NORMALSystem calibrated and operating normally'
2014-02-27 03:07:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 03:08:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-02-27 03:08:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 03:08:01 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 03:08:01 [DEBUG   ] Finished updating board flags in 1.592 seconds
2014-02-27 03:08:12 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 03:08:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 03:08:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 03:09:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 03:09:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 03:09:01 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 03:09:01 [DEBUG   ] Finished updating board flags in 1.415 seconds
2014-02-27 03:09:12 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 03:09:32 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 03:09:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 03:10:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2014-02-27 03:10:01 [DEBUG   ] Finished updating board flags in 1.374 seconds
2014-02-27 03:10:12 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2014-02-27 03:10:33 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-02-27 03:10:53 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2014-02-27 03:11:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 03:11:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 03:11:01 [DEBUG   ] Finished updating board flags in 1.348 seconds
2014-02-27 03:11:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-27 03:11:33 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 03:11:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 03:12:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 03:12:02 [DEBUG   ] Finished updating board flags in 2.075 seconds
2014-02-27 03:12:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 03:12:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 03:12:35 [DEBUG   ] Got command RPT from MCS: ref #288648
2014-02-27 03:12:35 [DEBUG   ] summary = NORMAL
2014-02-27 03:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288648  14 56715 11555649 A NORMALNORMAL'
2014-02-27 03:12:35 [DEBUG   ] Got command RPT from MCS: ref #288649
2014-02-27 03:12:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 03:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288649  48 56715 11555650 A NORMALSystem calibrated and operating normally'
2014-02-27 03:12:53 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 03:13:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 03:13:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-02-27 03:13:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 03:13:02 [DEBUG   ] Finished updating board flags in 2.032 seconds
2014-02-27 03:13:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 03:13:33 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-27 03:13:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 03:14:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 03:14:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 03:14:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 03:14:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 03:14:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 03:14:02 [DEBUG   ] Finished updating board flags in 1.964 seconds
2014-02-27 03:14:13 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 03:14:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 03:14:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 03:15:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 03:15:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 03:15:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-02-27 03:15:02 [DEBUG   ] Finished updating board flags in 1.818 seconds
2014-02-27 03:15:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-27 03:15:33 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 03:15:54 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-02-27 03:16:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 03:16:02 [DEBUG   ] Finished updating board flags in 1.779 seconds
2014-02-27 03:16:13 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-02-27 03:16:34 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2014-02-27 03:16:54 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-27 03:17:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 03:17:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 03:17:02 [DEBUG   ] Finished updating board flags in 1.624 seconds
2014-02-27 03:17:14 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-27 03:17:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 03:17:35 [DEBUG   ] Got command RPT from MCS: ref #288665
2014-02-27 03:17:35 [DEBUG   ] summary = NORMAL
2014-02-27 03:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288665  14 56715 11855641 A NORMALNORMAL'
2014-02-27 03:17:35 [DEBUG   ] Got command RPT from MCS: ref #288666
2014-02-27 03:17:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 03:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288666  48 56715 11855642 A NORMALSystem calibrated and operating normally'
2014-02-27 03:17:54 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 03:18:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 03:18:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 03:18:02 [DEBUG   ] Finished updating board flags in 1.588 seconds
2014-02-27 03:18:14 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 03:18:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 03:18:54 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 03:19:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-27 03:19:02 [DEBUG   ] Finished updating board flags in 1.401 seconds
2014-02-27 03:19:14 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2014-02-27 03:19:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 03:19:54 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2014-02-27 03:20:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 03:20:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2014-02-27 03:20:02 [DEBUG   ] Finished updating board flags in 1.392 seconds
2014-02-27 03:20:14 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 03:20:34 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 03:20:55 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-02-27 03:21:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2014-02-27 03:21:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 03:21:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 03:21:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 03:21:02 [DEBUG   ] Finished updating board flags in 1.350 seconds
2014-02-27 03:21:14 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2014-02-27 03:21:35 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-02-27 03:21:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 03:22:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 03:22:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 03:22:03 [DEBUG   ] Finished updating board flags in 2.061 seconds
2014-02-27 03:22:15 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-02-27 03:22:35 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 03:22:35 [DEBUG   ] Got command RPT from MCS: ref #288682
2014-02-27 03:22:35 [DEBUG   ] summary = NORMAL
2014-02-27 03:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288682  14 56715 12155649 A NORMALNORMAL'
2014-02-27 03:22:35 [DEBUG   ] Got command RPT from MCS: ref #288683
2014-02-27 03:22:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 03:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288683  48 56715 12155650 A NORMALSystem calibrated and operating normally'
2014-02-27 03:22:55 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 03:23:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 03:23:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 03:23:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 03:23:03 [DEBUG   ] Finished updating board flags in 1.995 seconds
2014-02-27 03:23:15 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 03:23:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 03:23:55 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 03:24:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 03:24:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 03:24:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 03:24:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 03:24:03 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 03:24:03 [DEBUG   ] Finished updating board flags in 1.813 seconds
2014-02-27 03:24:15 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 03:24:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 03:24:55 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-27 03:25:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 03:25:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2014-02-27 03:25:03 [CRITICAL] MGT underflow detected on beam(s) 1
2014-02-27 03:25:03 [DEBUG   ] Finished updating board flags in 1.812 seconds
2014-02-27 03:25:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-27 03:25:35 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 03:25:56 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-02-27 03:26:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 03:26:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 03:26:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 03:26:03 [DEBUG   ] Finished updating board flags in 1.785 seconds
2014-02-27 03:26:16 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 03:26:36 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 03:26:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 03:27:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 03:27:03 [DEBUG   ] Finished updating board flags in 1.609 seconds
2014-02-27 03:27:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 03:27:35 [DEBUG   ] Got command RPT from MCS: ref #288699
2014-02-27 03:27:35 [DEBUG   ] summary = ERROR
2014-02-27 03:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288699  13 56715 12455650 A  ERRORERROR'
2014-02-27 03:27:35 [DEBUG   ] Got command RPT from MCS: ref #288700
2014-02-27 03:27:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 03:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288700  77 56715 12455650 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 03:27:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 03:27:56 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 03:28:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 03:28:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 03:28:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 03:28:03 [DEBUG   ] Finished updating board flags in 1.587 seconds
2014-02-27 03:28:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-27 03:28:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 03:28:56 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 03:29:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 03:29:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 03:29:03 [DEBUG   ] Finished updating board flags in 1.422 seconds
2014-02-27 03:29:16 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 03:29:36 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2014-02-27 03:29:57 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-02-27 03:30:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 03:30:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 03:30:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 03:30:03 [DEBUG   ] Finished updating board flags in 1.388 seconds
2014-02-27 03:30:17 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2014-02-27 03:30:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-27 03:30:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 03:31:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 03:31:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 03:31:03 [DEBUG   ] Finished updating board flags in 1.351 seconds
2014-02-27 03:31:17 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 03:31:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 03:31:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 03:32:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 03:32:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 03:32:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 03:32:04 [DEBUG   ] Finished updating board flags in 2.070 seconds
2014-02-27 03:32:17 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 03:32:35 [DEBUG   ] Got command RPT from MCS: ref #288716
2014-02-27 03:32:35 [DEBUG   ] summary = ERROR
2014-02-27 03:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288716  13 56715 12755649 A  ERRORERROR'
2014-02-27 03:32:35 [DEBUG   ] Got command RPT from MCS: ref #288717
2014-02-27 03:32:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 03:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288717  77 56715 12755650 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 03:32:37 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 03:32:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 03:33:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 03:33:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 03:33:04 [DEBUG   ] Finished updating board flags in 1.982 seconds
2014-02-27 03:33:17 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 03:33:37 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 03:33:57 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 03:34:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 03:34:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 03:34:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 03:34:04 [DEBUG   ] Finished updating board flags in 1.900 seconds
2014-02-27 03:34:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 03:34:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-27 03:34:57 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-27 03:35:04 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 03:35:04 [DEBUG   ] Finished updating board flags in 1.807 seconds
2014-02-27 03:35:17 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2014-02-27 03:35:37 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2014-02-27 03:35:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 03:36:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 03:36:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 03:36:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 03:36:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-02-27 03:36:04 [DEBUG   ] Finished updating board flags in 1.711 seconds
2014-02-27 03:36:18 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 03:36:38 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2014-02-27 03:36:58 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2014-02-27 03:37:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 03:37:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 03:37:04 [DEBUG   ] Finished updating board flags in 1.614 seconds
2014-02-27 03:37:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 03:37:35 [DEBUG   ] Got command RPT from MCS: ref #288733
2014-02-27 03:37:35 [DEBUG   ] summary = ERROR
2014-02-27 03:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288733  13 56715 13055646 A  ERRORERROR'
2014-02-27 03:37:35 [DEBUG   ] Got command RPT from MCS: ref #288734
2014-02-27 03:37:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 03:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288734  77 56715 13055646 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 03:37:38 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 03:37:58 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-27 03:38:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 03:38:04 [DEBUG   ] Finished updating board flags in 1.579 seconds
2014-02-27 03:38:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 03:38:38 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 03:38:58 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 03:39:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 03:39:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 03:39:04 [DEBUG   ] Finished updating board flags in 1.425 seconds
2014-02-27 03:39:19 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-02-27 03:39:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 03:39:59 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 03:40:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 03:40:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 03:40:04 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 03:40:04 [DEBUG   ] Finished updating board flags in 1.385 seconds
2014-02-27 03:40:19 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 03:40:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 03:40:59 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 03:41:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 03:41:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 03:41:04 [DEBUG   ] Finished updating board flags in 1.375 seconds
2014-02-27 03:41:19 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 03:41:39 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-27 03:41:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 03:42:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-02-27 03:42:05 [DEBUG   ] Finished updating board flags in 2.041 seconds
2014-02-27 03:42:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-27 03:42:35 [DEBUG   ] Got command RPT from MCS: ref #288750
2014-02-27 03:42:35 [DEBUG   ] summary = ERROR
2014-02-27 03:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288750  13 56715 13355653 A  ERRORERROR'
2014-02-27 03:42:35 [DEBUG   ] Got command RPT from MCS: ref #288751
2014-02-27 03:42:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 03:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288751  77 56715 13355654 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 03:42:39 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2014-02-27 03:43:00 [DEBUG   ] Finished updating ant stats in 1.406 seconds
2014-02-27 03:43:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 03:43:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2014-02-27 03:43:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 03:43:05 [DEBUG   ] Finished updating board flags in 1.983 seconds
2014-02-27 03:43:20 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-02-27 03:43:40 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-27 03:44:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 03:44:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 03:44:05 [DEBUG   ] Finished updating board flags in 1.821 seconds
2014-02-27 03:44:20 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2014-02-27 03:44:40 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 03:45:00 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 03:45:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 03:45:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-27 03:45:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 03:45:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 03:45:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 03:45:05 [DEBUG   ] Finished updating board flags in 1.781 seconds
2014-02-27 03:45:20 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 03:45:40 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-27 03:46:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 03:46:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 03:46:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 03:46:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 03:46:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 03:46:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 03:46:05 [DEBUG   ] Finished updating board flags in 1.609 seconds
2014-02-27 03:46:20 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2014-02-27 03:46:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 03:47:00 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2014-02-27 03:47:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 03:47:05 [DEBUG   ] Finished updating board flags in 1.586 seconds
2014-02-27 03:47:20 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 03:47:35 [DEBUG   ] Got command RPT from MCS: ref #288767
2014-02-27 03:47:35 [DEBUG   ] summary = ERROR
2014-02-27 03:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288767  13 56715 13655650 A  ERRORERROR'
2014-02-27 03:47:35 [DEBUG   ] Got command RPT from MCS: ref #288768
2014-02-27 03:47:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 03:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288768  77 56715 13655650 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 03:47:40 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 03:48:00 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-02-27 03:48:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 03:48:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 03:48:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 03:48:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 03:48:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 03:48:05 [DEBUG   ] Finished updating board flags in 1.419 seconds
2014-02-27 03:48:21 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2014-02-27 03:48:41 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-27 03:49:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 03:49:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 03:49:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 03:49:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2014-02-27 03:49:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2014-02-27 03:49:05 [DEBUG   ] Finished updating board flags in 1.387 seconds
2014-02-27 03:49:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 03:49:41 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 03:50:01 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2014-02-27 03:50:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 03:50:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2014-02-27 03:50:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-02-27 03:50:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 03:50:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 03:50:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2014-02-27 03:50:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 03:50:05 [DEBUG   ] Finished updating board flags in 1.356 seconds
2014-02-27 03:50:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 03:50:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 03:51:01 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 03:51:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 03:51:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 03:51:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 03:51:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 03:51:06 [DEBUG   ] Finished updating board flags in 2.079 seconds
2014-02-27 03:51:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 03:51:41 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-27 03:52:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 03:52:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 03:52:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-02-27 03:52:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2014-02-27 03:52:06 [DEBUG   ] Finished updating board flags in 1.978 seconds
2014-02-27 03:52:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 03:52:35 [DEBUG   ] Got command RPT from MCS: ref #288784
2014-02-27 03:52:35 [DEBUG   ] summary = ERROR
2014-02-27 03:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288784  13 56715 13955654 A  ERRORERROR'
2014-02-27 03:52:35 [DEBUG   ] Got command RPT from MCS: ref #288785
2014-02-27 03:52:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 03:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288785  77 56715 13955654 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 03:52:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 03:53:01 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-27 03:53:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 03:53:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 03:53:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 03:53:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 03:53:06 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 03:53:06 [DEBUG   ] Finished updating board flags in 1.810 seconds
2014-02-27 03:53:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 03:53:41 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 03:54:02 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2014-02-27 03:54:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 03:54:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 03:54:06 [DEBUG   ] Finished updating board flags in 1.805 seconds
2014-02-27 03:54:21 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-02-27 03:54:42 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-02-27 03:55:02 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-27 03:55:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 03:55:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 03:55:06 [DEBUG   ] Finished updating board flags in 1.784 seconds
2014-02-27 03:55:22 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2014-02-27 03:55:42 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 03:56:02 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 03:56:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 03:56:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 03:56:06 [DEBUG   ] Finished updating board flags in 1.612 seconds
2014-02-27 03:56:22 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 03:56:42 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2014-02-27 03:57:02 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-27 03:57:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 03:57:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 03:57:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 03:57:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 03:57:06 [DEBUG   ] Finished updating board flags in 1.613 seconds
2014-02-27 03:57:22 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 03:57:35 [DEBUG   ] Got command RPT from MCS: ref #288801
2014-02-27 03:57:35 [DEBUG   ] summary = ERROR
2014-02-27 03:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288801  13 56715 14255658 A  ERRORERROR'
2014-02-27 03:57:35 [DEBUG   ] Got command RPT from MCS: ref #288802
2014-02-27 03:57:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 03:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288802  77 56715 14255658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 03:57:43 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-02-27 03:58:03 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-27 03:58:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 03:58:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2014-02-27 03:58:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 03:58:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 03:58:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 03:58:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 03:58:06 [DEBUG   ] Finished updating board flags in 1.589 seconds
2014-02-27 03:58:23 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-27 03:58:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 03:59:03 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-27 03:59:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-27 03:59:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 03:59:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 03:59:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 03:59:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 03:59:06 [DEBUG   ] Finished updating board flags in 1.410 seconds
2014-02-27 03:59:23 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 03:59:43 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2014-02-27 04:00:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 04:00:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 04:00:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 04:00:06 [DEBUG   ] Finished updating board flags in 1.383 seconds
2014-02-27 04:00:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 04:00:43 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 04:01:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 04:01:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 04:01:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 04:01:06 [DEBUG   ] Finished updating board flags in 1.353 seconds
2014-02-27 04:01:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 04:01:43 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-27 04:02:03 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2014-02-27 04:02:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 04:02:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 04:02:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 04:02:07 [DEBUG   ] Finished updating board flags in 2.065 seconds
2014-02-27 04:02:23 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 04:02:35 [DEBUG   ] Got command RPT from MCS: ref #288818
2014-02-27 04:02:35 [DEBUG   ] summary = ERROR
2014-02-27 04:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288818  13 56715 14555661 A  ERRORERROR'
2014-02-27 04:02:35 [DEBUG   ] Got command RPT from MCS: ref #288819
2014-02-27 04:02:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 04:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288819  77 56715 14555662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 04:02:44 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-02-27 04:03:04 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-27 04:03:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-02-27 04:03:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-02-27 04:03:07 [DEBUG   ] Finished updating board flags in 1.989 seconds
2014-02-27 04:03:24 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 04:03:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 04:04:04 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-27 04:04:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 04:04:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 04:04:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 04:04:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 04:04:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 04:04:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 04:04:07 [DEBUG   ] Finished updating board flags in 1.821 seconds
2014-02-27 04:04:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 04:04:44 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 04:05:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 04:05:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 04:05:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 04:05:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 04:05:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 04:05:07 [DEBUG   ] Finished updating board flags in 1.786 seconds
2014-02-27 04:05:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 04:05:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 04:06:04 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2014-02-27 04:06:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 04:06:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 04:06:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 5
2014-02-27 04:06:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 04:06:07 [DEBUG   ] Finished updating board flags in 1.613 seconds
2014-02-27 04:06:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 04:06:44 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-27 04:07:04 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 04:07:07 [DEBUG   ] Finished updating board flags in 1.585 seconds
2014-02-27 04:07:24 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 04:07:35 [DEBUG   ] Got command RPT from MCS: ref #288835
2014-02-27 04:07:35 [DEBUG   ] summary = ERROR
2014-02-27 04:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288835  13 56715 14855657 A  ERRORERROR'
2014-02-27 04:07:35 [DEBUG   ] Got command RPT from MCS: ref #288836
2014-02-27 04:07:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 04:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288836  77 56715 14855658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 04:07:45 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-02-27 04:08:05 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-02-27 04:08:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 04:08:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 04:08:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2014-02-27 04:08:07 [DEBUG   ] Finished updating board flags in 1.408 seconds
2014-02-27 04:08:25 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-27 04:08:45 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-27 04:09:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-27 04:09:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 04:09:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 04:09:07 [DEBUG   ] Finished updating board flags in 1.406 seconds
2014-02-27 04:09:25 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 04:09:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 04:10:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 04:10:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 04:10:07 [DEBUG   ] Finished updating board flags in 1.400 seconds
2014-02-27 04:10:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 04:10:45 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 04:11:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 04:11:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 04:11:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 04:11:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 04:11:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 04:11:07 [DEBUG   ] Finished updating board flags in 1.347 seconds
2014-02-27 04:11:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 04:11:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-27 04:12:05 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 04:12:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 04:12:08 [DEBUG   ] Finished updating board flags in 2.072 seconds
2014-02-27 04:12:25 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-27 04:12:35 [DEBUG   ] Got command RPT from MCS: ref #288852
2014-02-27 04:12:35 [DEBUG   ] summary = ERROR
2014-02-27 04:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288852  13 56715 15155653 A  ERRORERROR'
2014-02-27 04:12:35 [DEBUG   ] Got command RPT from MCS: ref #288853
2014-02-27 04:12:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 04:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288853  77 56715 15155654 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 04:12:46 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-02-27 04:13:06 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-27 04:13:07 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 04:13:08 [DEBUG   ] Finished updating board flags in 2.016 seconds
2014-02-27 04:13:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 04:13:46 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-27 04:14:06 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 04:14:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 04:14:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 04:14:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 04:14:08 [DEBUG   ] Finished updating board flags in 1.966 seconds
2014-02-27 04:14:26 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 04:14:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 04:15:06 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-27 04:15:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 04:15:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 04:15:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 04:15:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-02-27 04:15:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 04:15:08 [DEBUG   ] Finished updating board flags in 1.833 seconds
2014-02-27 04:15:26 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2014-02-27 04:15:46 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2014-02-27 04:16:06 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-27 04:16:07 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 04:16:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 04:16:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 04:16:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 04:16:08 [DEBUG   ] Finished updating board flags in 1.765 seconds
2014-02-27 04:16:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-27 04:16:46 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 04:17:06 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 04:17:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 04:17:08 [DEBUG   ] Finished updating board flags in 1.622 seconds
2014-02-27 04:17:26 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-02-27 04:17:35 [DEBUG   ] Got command RPT from MCS: ref #288869
2014-02-27 04:17:35 [DEBUG   ] summary = ERROR
2014-02-27 04:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288869  13 56715 15455662 A  ERRORERROR'
2014-02-27 04:17:35 [DEBUG   ] Got command RPT from MCS: ref #288870
2014-02-27 04:17:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 04:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288870  77 56715 15455662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 04:17:47 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-02-27 04:18:07 [DEBUG   ] Finished updating ant stats in 1.254 seconds
2014-02-27 04:18:08 [DEBUG   ] Finished updating board flags in 1.576 seconds
2014-02-27 04:18:27 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2014-02-27 04:18:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 04:19:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 04:19:07 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2014-02-27 04:19:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 04:19:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 04:19:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 04:19:08 [DEBUG   ] Finished updating board flags in 1.419 seconds
2014-02-27 04:19:27 [DEBUG   ] Finished updating ant stats in 0.955 seconds
2014-02-27 04:19:47 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-27 04:20:07 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2014-02-27 04:20:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 04:20:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 04:20:08 [DEBUG   ] Finished updating board flags in 1.391 seconds
2014-02-27 04:20:27 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2014-02-27 04:20:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 04:21:07 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-27 04:21:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 04:21:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-02-27 04:21:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 04:21:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 04:21:08 [DEBUG   ] Finished updating board flags in 1.361 seconds
2014-02-27 04:21:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 04:21:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 04:22:08 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-27 04:22:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-27 04:22:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 04:22:09 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 04:22:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 04:22:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 04:22:09 [DEBUG   ] Finished updating board flags in 2.071 seconds
2014-02-27 04:22:28 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2014-02-27 04:22:35 [DEBUG   ] Got command RPT from MCS: ref #288886
2014-02-27 04:22:35 [DEBUG   ] summary = ERROR
2014-02-27 04:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288886  13 56715 15755661 A  ERRORERROR'
2014-02-27 04:22:35 [DEBUG   ] Got command RPT from MCS: ref #288887
2014-02-27 04:22:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 04:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288887  77 56715 15755662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 04:22:48 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 04:23:08 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2014-02-27 04:23:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 04:23:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 04:23:09 [DEBUG   ] Finished updating board flags in 1.969 seconds
2014-02-27 04:23:28 [DEBUG   ] Finished updating ant stats in 0.956 seconds
2014-02-27 04:23:48 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-27 04:24:08 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2014-02-27 04:24:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 04:24:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 04:24:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 04:24:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 04:24:09 [DEBUG   ] Finished updating board flags in 1.837 seconds
2014-02-27 04:24:28 [DEBUG   ] Finished updating ant stats in 0.755 seconds
2014-02-27 04:24:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 04:25:08 [DEBUG   ] Finished updating ant stats in 0.650 seconds
2014-02-27 04:25:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 04:25:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 04:25:09 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 04:25:09 [DEBUG   ] Finished updating board flags in 1.768 seconds
2014-02-27 04:25:28 [DEBUG   ] Finished updating ant stats in 0.556 seconds
2014-02-27 04:25:49 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-02-27 04:26:09 [DEBUG   ] Finished updating ant stats in 1.248 seconds
2014-02-27 04:26:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 04:26:09 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 04:26:09 [DEBUG   ] Finished updating board flags in 1.687 seconds
2014-02-27 04:26:29 [DEBUG   ] Finished updating ant stats in 1.155 seconds
2014-02-27 04:26:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 04:27:09 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-27 04:27:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 04:27:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-27 04:27:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 04:27:10 [DEBUG   ] Finished updating board flags in 2.530 seconds
2014-02-27 04:27:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 04:27:35 [DEBUG   ] Got command RPT from MCS: ref #288903
2014-02-27 04:27:35 [DEBUG   ] summary = ERROR
2014-02-27 04:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288903  13 56715 16055669 A  ERRORERROR'
2014-02-27 04:27:35 [DEBUG   ] Got command RPT from MCS: ref #288904
2014-02-27 04:27:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 04:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288904  77 56715 16055670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 04:27:49 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-27 04:28:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 04:28:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 04:28:09 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2014-02-27 04:28:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 04:28:09 [DEBUG   ] Finished updating board flags in 1.445 seconds
2014-02-27 04:28:29 [DEBUG   ] Finished updating ant stats in 0.760 seconds
2014-02-27 04:28:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-27 04:29:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 04:29:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 04:29:09 [DEBUG   ] Finished updating ant stats in 0.643 seconds
2014-02-27 04:29:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 04:29:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 04:29:09 [DEBUG   ] Finished updating board flags in 1.481 seconds
2014-02-27 04:29:29 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2014-02-27 04:29:50 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-02-27 04:30:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 04:30:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 04:30:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 04:30:09 [DEBUG   ] Finished updating board flags in 1.464 seconds
2014-02-27 04:30:10 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-27 04:30:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 04:30:50 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-27 04:31:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-02-27 04:31:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 04:31:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 04:31:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 04:31:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 04:31:09 [DEBUG   ] Finished updating board flags in 1.496 seconds
2014-02-27 04:31:10 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 04:31:30 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 04:31:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 04:32:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 04:32:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 04:32:10 [DEBUG   ] Finished updating ant stats in 1.049 seconds
2014-02-27 04:32:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 04:32:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 04:32:10 [DEBUG   ] Finished updating board flags in 2.184 seconds
2014-02-27 04:32:30 [DEBUG   ] Finished updating ant stats in 0.956 seconds
2014-02-27 04:32:35 [DEBUG   ] Got command RPT from MCS: ref #288920
2014-02-27 04:32:35 [DEBUG   ] summary = ERROR
2014-02-27 04:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288920  13 56715 16355669 A  ERRORERROR'
2014-02-27 04:32:35 [DEBUG   ] Got command RPT from MCS: ref #288921
2014-02-27 04:32:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 04:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288921  77 56715 16355670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 04:32:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 04:33:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-27 04:33:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-02-27 04:33:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 04:33:10 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2014-02-27 04:33:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 04:33:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2014-02-27 04:33:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 04:33:10 [DEBUG   ] Finished updating board flags in 1.978 seconds
2014-02-27 04:33:30 [DEBUG   ] Finished updating ant stats in 0.761 seconds
2014-02-27 04:33:50 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 04:34:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-27 04:34:10 [DEBUG   ] Finished updating board flags in 1.821 seconds
2014-02-27 04:34:11 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-02-27 04:34:31 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-27 04:34:51 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 04:35:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 04:35:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 04:35:10 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 04:35:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 04:35:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 04:35:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 04:35:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 04:35:10 [DEBUG   ] Finished updating board flags in 1.828 seconds
2014-02-27 04:35:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 04:35:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 04:35:51 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-27 04:36:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-02-27 04:36:10 [DEBUG   ] Finished updating board flags in 1.757 seconds
2014-02-27 04:36:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 04:36:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 04:36:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 04:37:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 04:37:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 04:37:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 04:37:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 04:37:10 [DEBUG   ] Finished updating board flags in 1.616 seconds
2014-02-27 04:37:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 04:37:31 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2014-02-27 04:37:35 [DEBUG   ] Got command RPT from MCS: ref #288937
2014-02-27 04:37:35 [DEBUG   ] summary = ERROR
2014-02-27 04:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288937  13 56715 16655669 A  ERRORERROR'
2014-02-27 04:37:35 [DEBUG   ] Got command RPT from MCS: ref #288938
2014-02-27 04:37:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 04:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288938  77 56715 16655670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 04:37:51 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 04:38:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 04:38:10 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 04:38:10 [DEBUG   ] Finished updating board flags in 1.596 seconds
2014-02-27 04:38:11 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-27 04:38:31 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2014-02-27 04:38:52 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-02-27 04:39:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 04:39:10 [DEBUG   ] Finished updating board flags in 1.413 seconds
2014-02-27 04:39:12 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-27 04:39:32 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-27 04:39:52 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 04:40:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 04:40:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 04:40:10 [DEBUG   ] Finished updating board flags in 1.422 seconds
2014-02-27 04:40:12 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-27 04:40:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 04:40:52 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 04:41:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 04:41:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 04:41:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 04:41:10 [DEBUG   ] Finished updating board flags in 1.413 seconds
2014-02-27 04:41:12 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 04:41:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 04:41:52 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-27 04:42:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 04:42:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 04:42:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 04:42:10 [DEBUG   ] Finished updating board flags in 1.416 seconds
2014-02-27 04:42:12 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-27 04:42:32 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 04:42:35 [DEBUG   ] Got command RPT from MCS: ref #288954
2014-02-27 04:42:35 [DEBUG   ] summary = ERROR
2014-02-27 04:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288954  13 56715 16955669 A  ERRORERROR'
2014-02-27 04:42:35 [DEBUG   ] Got command RPT from MCS: ref #288955
2014-02-27 04:42:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 04:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288955  77 56715 16955670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 04:42:52 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-27 04:43:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 04:43:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 04:43:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 04:43:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 04:43:10 [DEBUG   ] Finished updating board flags in 1.347 seconds
2014-02-27 04:43:13 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-02-27 04:43:32 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2014-02-27 04:43:53 [DEBUG   ] Finished updating ant stats in 1.391 seconds
2014-02-27 04:44:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-27 04:44:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 04:44:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 04:44:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 04:44:11 [DEBUG   ] Finished updating board flags in 2.168 seconds
2014-02-27 04:44:13 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-27 04:44:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-27 04:44:53 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2014-02-27 04:45:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 04:45:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 04:45:11 [DEBUG   ] Finished updating board flags in 1.974 seconds
2014-02-27 04:45:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 04:45:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 04:45:53 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-27 04:46:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-02-27 04:46:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-02-27 04:46:11 [DEBUG   ] Finished updating board flags in 1.820 seconds
2014-02-27 04:46:13 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-27 04:46:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 04:46:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 04:47:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-02-27 04:47:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 04:47:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 04:47:11 [DEBUG   ] Finished updating board flags in 1.784 seconds
2014-02-27 04:47:13 [DEBUG   ] Finished updating ant stats in 0.792 seconds
2014-02-27 04:47:33 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-02-27 04:47:35 [DEBUG   ] Got command RPT from MCS: ref #288971
2014-02-27 04:47:35 [DEBUG   ] summary = ERROR
2014-02-27 04:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288971  13 56715 17255665 A  ERRORERROR'
2014-02-27 04:47:35 [DEBUG   ] Got command RPT from MCS: ref #288972
2014-02-27 04:47:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 04:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288972  77 56715 17255666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 04:47:53 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-27 04:48:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 04:48:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 04:48:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 04:48:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 04:48:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 1
2014-02-27 04:48:11 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 04:48:11 [DEBUG   ] Finished updating board flags in 1.627 seconds
2014-02-27 04:48:14 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-02-27 04:48:34 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-27 04:48:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 04:49:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 04:49:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 04:49:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 04:49:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 04:49:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-02-27 04:49:11 [DEBUG   ] Finished updating board flags in 1.591 seconds
2014-02-27 04:49:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-27 04:49:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 04:49:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 04:50:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 04:50:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2014-02-27 04:50:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-27 04:50:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 04:50:11 [DEBUG   ] Finished updating board flags in 1.418 seconds
2014-02-27 04:50:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 04:50:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 04:50:54 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 04:51:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 04:51:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 04:51:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 04:51:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 04:51:11 [DEBUG   ] Finished updating board flags in 1.402 seconds
2014-02-27 04:51:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 04:51:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 04:51:54 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-27 04:52:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 04:52:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 04:52:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2014-02-27 04:52:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 04:52:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 04:52:11 [DEBUG   ] Finished updating board flags in 1.416 seconds
2014-02-27 04:52:14 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 04:52:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 04:52:35 [DEBUG   ] Got command RPT from MCS: ref #288988
2014-02-27 04:52:35 [DEBUG   ] summary = ERROR
2014-02-27 04:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288988  13 56715 17555669 A  ERRORERROR'
2014-02-27 04:52:35 [DEBUG   ] Got command RPT from MCS: ref #288989
2014-02-27 04:52:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 04:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   288989  77 56715 17555670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 04:52:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 04:53:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 04:53:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 04:53:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 04:53:11 [DEBUG   ] Finished updating board flags in 1.371 seconds
2014-02-27 04:53:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 04:53:34 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 04:53:55 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-02-27 04:54:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 04:54:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 04:54:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2014-02-27 04:54:11 [DEBUG   ] Finished updating board flags in 1.364 seconds
2014-02-27 04:54:15 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2014-02-27 04:54:35 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2014-02-27 04:54:55 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2014-02-27 04:55:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 04:55:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 04:55:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 04:55:12 [DEBUG   ] Finished updating board flags in 2.045 seconds
2014-02-27 04:55:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 04:55:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 04:55:55 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 04:56:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 04:56:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 04:56:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 04:56:12 [DEBUG   ] Finished updating board flags in 2.008 seconds
2014-02-27 04:56:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 04:56:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 04:56:55 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-27 04:57:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 04:57:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 04:57:12 [DEBUG   ] Finished updating board flags in 1.988 seconds
2014-02-27 04:57:15 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 04:57:35 [DEBUG   ] Got command RPT from MCS: ref #289005
2014-02-27 04:57:35 [DEBUG   ] summary = ERROR
2014-02-27 04:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289005  13 56715 17855670 A  ERRORERROR'
2014-02-27 04:57:35 [DEBUG   ] Got command RPT from MCS: ref #289006
2014-02-27 04:57:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 04:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289006  77 56715 17855670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 04:57:36 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-02-27 04:57:56 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2014-02-27 04:58:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 04:58:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 04:58:12 [DEBUG   ] Finished updating board flags in 1.810 seconds
2014-02-27 04:58:16 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 04:58:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 04:58:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 04:59:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 04:59:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 04:59:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-02-27 04:59:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 04:59:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2014-02-27 04:59:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 04:59:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 04:59:12 [DEBUG   ] Finished updating board flags in 1.796 seconds
2014-02-27 04:59:16 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-27 04:59:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 04:59:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 05:00:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 05:00:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 05:00:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 05:00:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 05:00:12 [DEBUG   ] Finished updating board flags in 1.607 seconds
2014-02-27 05:00:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 05:00:36 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-27 05:00:56 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2014-02-27 05:01:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 05:01:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 05:01:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 05:01:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 05:01:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 05:01:12 [DEBUG   ] Finished updating board flags in 1.596 seconds
2014-02-27 05:01:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 05:01:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 05:01:56 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-27 05:02:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 05:02:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 05:02:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 05:02:12 [DEBUG   ] Finished updating board flags in 1.410 seconds
2014-02-27 05:02:16 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 05:02:35 [DEBUG   ] Got command RPT from MCS: ref #289022
2014-02-27 05:02:35 [DEBUG   ] summary = ERROR
2014-02-27 05:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289022  13 56715 18155677 A  ERRORERROR'
2014-02-27 05:02:35 [DEBUG   ] Got command RPT from MCS: ref #289023
2014-02-27 05:02:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 05:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289023  77 56715 18155678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 05:02:37 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-02-27 05:02:57 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-27 05:03:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 05:03:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-02-27 05:03:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 05:03:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 05:03:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2014-02-27 05:03:12 [DEBUG   ] Finished updating board flags in 1.387 seconds
2014-02-27 05:03:17 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2014-02-27 05:03:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 05:03:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 05:04:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 05:04:12 [DEBUG   ] Finished updating board flags in 1.364 seconds
2014-02-27 05:04:17 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-27 05:04:37 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-27 05:04:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 05:05:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 05:05:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 05:05:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 05:05:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2014-02-27 05:05:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 05:05:13 [DEBUG   ] Finished updating board flags in 2.056 seconds
2014-02-27 05:05:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 05:05:37 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 05:05:57 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-02-27 05:06:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 05:06:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 05:06:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 05:06:13 [DEBUG   ] Finished updating board flags in 2.021 seconds
2014-02-27 05:06:17 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 05:06:38 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-02-27 05:06:58 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-27 05:07:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 05:07:13 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 05:07:13 [DEBUG   ] Finished updating board flags in 1.967 seconds
2014-02-27 05:07:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 05:07:35 [DEBUG   ] Got command RPT from MCS: ref #289039
2014-02-27 05:07:35 [DEBUG   ] summary = ERROR
2014-02-27 05:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289039  13 56715 18455669 A  ERRORERROR'
2014-02-27 05:07:35 [DEBUG   ] Got command RPT from MCS: ref #289040
2014-02-27 05:07:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 05:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289040  77 56715 18455670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 05:07:38 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-27 05:07:58 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2014-02-27 05:08:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 05:08:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 05:08:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 05:08:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 05:08:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 05:08:13 [DEBUG   ] Finished updating board flags in 1.815 seconds
2014-02-27 05:08:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 05:08:38 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2014-02-27 05:08:58 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-27 05:09:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 05:09:13 [DEBUG   ] Finished updating board flags in 1.782 seconds
2014-02-27 05:09:18 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2014-02-27 05:09:38 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2014-02-27 05:09:59 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-02-27 05:10:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 05:10:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 05:10:13 [DEBUG   ] Finished updating board flags in 1.619 seconds
2014-02-27 05:10:18 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2014-02-27 05:10:39 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-02-27 05:10:59 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-27 05:11:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 05:11:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-02-27 05:11:13 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 05:11:13 [DEBUG   ] Finished updating board flags in 1.600 seconds
2014-02-27 05:11:19 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-27 05:11:39 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2014-02-27 05:11:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 05:12:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2014-02-27 05:12:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 05:12:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2014-02-27 05:12:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 05:12:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 05:12:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 05:12:13 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 05:12:13 [DEBUG   ] Finished updating board flags in 1.406 seconds
2014-02-27 05:12:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 05:12:35 [DEBUG   ] Got command RPT from MCS: ref #289056
2014-02-27 05:12:35 [DEBUG   ] summary = ERROR
2014-02-27 05:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289056  13 56715 18755673 A  ERRORERROR'
2014-02-27 05:12:35 [DEBUG   ] Got command RPT from MCS: ref #289057
2014-02-27 05:12:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 05:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289057  77 56715 18755674 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 05:12:39 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-27 05:12:59 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 05:13:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 1
2014-02-27 05:13:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 05:13:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 05:13:13 [DEBUG   ] Finished updating board flags in 1.397 seconds
2014-02-27 05:13:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 05:13:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 05:13:59 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-27 05:14:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 05:14:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 05:14:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 05:14:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 05:14:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 05:14:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 05:14:14 [DEBUG   ] Finished updating board flags in 2.212 seconds
2014-02-27 05:14:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 05:14:39 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-02-27 05:15:00 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-02-27 05:15:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 05:15:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 05:15:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 05:15:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 05:15:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-02-27 05:15:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 05:15:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 05:15:14 [DEBUG   ] Finished updating board flags in 2.178 seconds
2014-02-27 05:15:19 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-02-27 05:15:40 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-02-27 05:16:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 05:16:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 05:16:14 [DEBUG   ] Finished updating board flags in 2.020 seconds
2014-02-27 05:16:20 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-27 05:16:40 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 05:17:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 05:17:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 05:17:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-27 05:17:14 [DEBUG   ] Finished updating board flags in 1.989 seconds
2014-02-27 05:17:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 05:17:35 [DEBUG   ] Got command RPT from MCS: ref #289073
2014-02-27 05:17:35 [DEBUG   ] summary = ERROR
2014-02-27 05:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289073  13 56715 19055674 A  ERRORERROR'
2014-02-27 05:17:35 [DEBUG   ] Got command RPT from MCS: ref #289074
2014-02-27 05:17:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 05:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289074  77 56715 19055674 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 05:17:40 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 05:18:00 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 05:18:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 05:18:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 05:18:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 05:18:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 05:18:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 05:18:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 05:18:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 05:18:14 [DEBUG   ] Finished updating board flags in 1.869 seconds
2014-02-27 05:18:20 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-02-27 05:18:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 05:19:00 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-27 05:19:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-02-27 05:19:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 05:19:14 [DEBUG   ] Finished updating board flags in 1.727 seconds
2014-02-27 05:19:20 [DEBUG   ] Finished updating ant stats in 0.591 seconds
2014-02-27 05:19:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 05:20:01 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-27 05:20:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 05:20:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-02-27 05:20:14 [DEBUG   ] Finished updating board flags in 1.615 seconds
2014-02-27 05:20:21 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-02-27 05:20:41 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-27 05:21:01 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-27 05:21:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 05:21:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 05:21:14 [DEBUG   ] Finished updating board flags in 1.593 seconds
2014-02-27 05:21:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-27 05:21:41 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 05:22:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-27 05:22:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 05:22:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 05:22:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 05:22:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 05:22:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 05:22:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 1
2014-02-27 05:22:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 05:22:14 [DEBUG   ] Finished updating board flags in 1.412 seconds
2014-02-27 05:22:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 05:22:35 [DEBUG   ] Got command RPT from MCS: ref #289090
2014-02-27 05:22:35 [DEBUG   ] summary = ERROR
2014-02-27 05:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289090  13 56715 19355677 A  ERRORERROR'
2014-02-27 05:22:35 [DEBUG   ] Got command RPT from MCS: ref #289091
2014-02-27 05:22:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 05:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289091  77 56715 19355678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 05:22:41 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 05:23:01 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2014-02-27 05:23:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 05:23:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 05:23:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 05:23:14 [DEBUG   ] Finished updating board flags in 1.416 seconds
2014-02-27 05:23:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 05:23:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 05:24:01 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2014-02-27 05:24:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 05:24:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 05:24:14 [DEBUG   ] Finished updating board flags in 1.522 seconds
2014-02-27 05:24:22 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-02-27 05:24:42 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2014-02-27 05:25:02 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 05:25:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-02-27 05:25:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 05:25:14 [DEBUG   ] Finished updating board flags in 1.382 seconds
2014-02-27 05:25:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 05:25:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 05:26:02 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-27 05:26:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 05:26:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 05:26:15 [DEBUG   ] Finished updating board flags in 2.100 seconds
2014-02-27 05:26:22 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 05:26:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 05:27:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 05:27:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 05:27:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 05:27:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 05:27:15 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 05:27:15 [DEBUG   ] Finished updating board flags in 1.990 seconds
2014-02-27 05:27:22 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-27 05:27:35 [DEBUG   ] Got command RPT from MCS: ref #289107
2014-02-27 05:27:35 [DEBUG   ] summary = ERROR
2014-02-27 05:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289107  13 56715 19655681 A  ERRORERROR'
2014-02-27 05:27:35 [DEBUG   ] Got command RPT from MCS: ref #289108
2014-02-27 05:27:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 05:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289108  77 56715 19655682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 05:27:42 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 05:28:02 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-02-27 05:28:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 05:28:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-27 05:28:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 05:28:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 05:28:15 [DEBUG   ] Finished updating board flags in 1.815 seconds
2014-02-27 05:28:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 05:28:42 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-27 05:29:02 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 05:29:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 05:29:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-02-27 05:29:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 05:29:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 05:29:14 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 05:29:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 05:29:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 05:29:15 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 05:29:15 [DEBUG   ] Finished updating board flags in 1.790 seconds
2014-02-27 05:29:22 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 05:29:43 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-02-27 05:30:02 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2014-02-27 05:30:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 05:30:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 05:30:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2014-02-27 05:30:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 05:30:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 05:30:15 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 05:30:15 [DEBUG   ] Finished updating board flags in 1.606 seconds
2014-02-27 05:30:23 [DEBUG   ] Finished updating ant stats in 1.386 seconds
2014-02-27 05:30:43 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-27 05:31:03 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 05:31:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 05:31:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 05:31:15 [DEBUG   ] Finished updating board flags in 1.609 seconds
2014-02-27 05:31:23 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 05:31:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 05:32:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 05:32:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 05:32:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 05:32:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 05:32:15 [DEBUG   ] Finished updating board flags in 1.584 seconds
2014-02-27 05:32:23 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 05:32:35 [DEBUG   ] Got command RPT from MCS: ref #289124
2014-02-27 05:32:35 [DEBUG   ] summary = ERROR
2014-02-27 05:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289124  13 56715 19955685 A  ERRORERROR'
2014-02-27 05:32:35 [DEBUG   ] Got command RPT from MCS: ref #289125
2014-02-27 05:32:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 05:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289125  77 56715 19955686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 05:32:43 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 05:33:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 05:33:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2014-02-27 05:33:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 05:33:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 05:33:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 05:33:15 [DEBUG   ] Finished updating board flags in 1.425 seconds
2014-02-27 05:33:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 05:33:43 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 05:34:03 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-02-27 05:34:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 05:34:15 [DEBUG   ] Finished updating board flags in 1.390 seconds
2014-02-27 05:34:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 05:34:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 05:35:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-27 05:35:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 05:35:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 05:35:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 05:35:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 05:35:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 05:35:15 [DEBUG   ] Finished updating board flags in 1.375 seconds
2014-02-27 05:35:23 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2014-02-27 05:35:44 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-02-27 05:36:04 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-27 05:36:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2014-02-27 05:36:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 05:36:16 [DEBUG   ] Finished updating board flags in 2.034 seconds
2014-02-27 05:36:24 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-02-27 05:36:44 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-27 05:37:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 05:37:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 05:37:16 [DEBUG   ] Finished updating board flags in 2.008 seconds
2014-02-27 05:37:24 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-27 05:37:35 [DEBUG   ] Got command RPT from MCS: ref #289141
2014-02-27 05:37:35 [DEBUG   ] summary = ERROR
2014-02-27 05:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289141  13 56715 20255681 A  ERRORERROR'
2014-02-27 05:37:35 [DEBUG   ] Got command RPT from MCS: ref #289142
2014-02-27 05:37:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 05:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289142  77 56715 20255682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 05:37:44 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2014-02-27 05:38:04 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-27 05:38:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 05:38:16 [DEBUG   ] Finished updating board flags in 1.988 seconds
2014-02-27 05:38:24 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 05:38:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 05:39:04 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 05:39:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 05:39:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 05:39:16 [DEBUG   ] Finished updating board flags in 1.808 seconds
2014-02-27 05:39:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 05:39:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 05:40:04 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-27 05:40:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 05:40:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 05:40:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 05:40:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2014-02-27 05:40:16 [DEBUG   ] Finished updating board flags in 1.784 seconds
2014-02-27 05:40:24 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 05:40:45 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2014-02-27 05:41:05 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-27 05:41:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 05:41:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 05:41:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2014-02-27 05:41:16 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 05:41:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 05:41:16 [DEBUG   ] Finished updating board flags in 1.614 seconds
2014-02-27 05:41:25 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-27 05:41:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 05:42:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 05:42:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 05:42:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 05:42:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 05:42:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2014-02-27 05:42:16 [DEBUG   ] Finished updating board flags in 1.608 seconds
2014-02-27 05:42:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-27 05:42:35 [DEBUG   ] Got command RPT from MCS: ref #289158
2014-02-27 05:42:35 [DEBUG   ] summary = ERROR
2014-02-27 05:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289158  13 56715 20555681 A  ERRORERROR'
2014-02-27 05:42:35 [DEBUG   ] Got command RPT from MCS: ref #289159
2014-02-27 05:42:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 05:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289159  77 56715 20555682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 05:42:45 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 05:43:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 05:43:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 05:43:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2014-02-27 05:43:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 05:43:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 05:43:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 05:43:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 05:43:16 [DEBUG   ] Finished updating board flags in 1.593 seconds
2014-02-27 05:43:25 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 05:43:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 05:44:05 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-02-27 05:44:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 05:44:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 05:44:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 05:44:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 05:44:16 [DEBUG   ] Finished updating board flags in 1.409 seconds
2014-02-27 05:44:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 05:44:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 05:45:05 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-27 05:45:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 05:45:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 05:45:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 05:45:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2014-02-27 05:45:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-27 05:45:16 [DEBUG   ] Finished updating board flags in 1.391 seconds
2014-02-27 05:45:25 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 05:45:45 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-27 05:46:06 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-02-27 05:46:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 05:46:17 [DEBUG   ] Finished updating board flags in 2.136 seconds
2014-02-27 05:46:26 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-27 05:46:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 05:47:06 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-27 05:47:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 05:47:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 05:47:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 05:47:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 05:47:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 05:47:17 [DEBUG   ] Finished updating board flags in 2.008 seconds
2014-02-27 05:47:26 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 05:47:35 [DEBUG   ] Got command RPT from MCS: ref #289175
2014-02-27 05:47:35 [DEBUG   ] summary = ERROR
2014-02-27 05:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289175  13 56715 20855689 A  ERRORERROR'
2014-02-27 05:47:35 [DEBUG   ] Got command RPT from MCS: ref #289176
2014-02-27 05:47:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 05:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289176  77 56715 20855690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 05:47:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 05:48:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 05:48:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 05:48:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 05:48:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 05:48:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 05:48:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 05:48:17 [DEBUG   ] Finished updating board flags in 1.984 seconds
2014-02-27 05:48:26 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-27 05:48:46 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 05:49:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 05:49:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-02-27 05:49:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 05:49:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 05:49:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 05:49:17 [DEBUG   ] Finished updating board flags in 1.812 seconds
2014-02-27 05:49:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 05:49:46 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-27 05:50:06 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 05:50:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 05:50:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 05:50:17 [DEBUG   ] Finished updating board flags in 1.888 seconds
2014-02-27 05:50:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 05:50:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 05:51:06 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-27 05:51:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 05:51:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 05:51:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-02-27 05:51:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 05:51:17 [DEBUG   ] Finished updating board flags in 1.708 seconds
2014-02-27 05:51:26 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 05:51:46 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 05:52:07 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2014-02-27 05:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2014-02-27 05:52:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 05:52:17 [DEBUG   ] Finished updating board flags in 1.627 seconds
2014-02-27 05:52:27 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-27 05:52:35 [DEBUG   ] Got command RPT from MCS: ref #289192
2014-02-27 05:52:35 [DEBUG   ] summary = ERROR
2014-02-27 05:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289192  13 56715 21155689 A  ERRORERROR'
2014-02-27 05:52:35 [DEBUG   ] Got command RPT from MCS: ref #289193
2014-02-27 05:52:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 05:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289193  77 56715 21155690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 05:52:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 05:53:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999921
2014-02-27 05:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999921
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 196000019
2014-02-27 05:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 196000019
2014-02-27 05:53:17 [DEBUG   ] Finished updating board flags in 1.575 seconds
2014-02-27 05:53:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 05:53:47 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-02-27 05:54:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-02-27 05:54:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-02-27 05:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-02-27 05:54:17 [DEBUG   ] Finished updating board flags in 1.432 seconds
2014-02-27 05:54:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 05:54:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 05:55:07 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 05:55:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 05:55:17 [DEBUG   ] Finished updating board flags in 1.402 seconds
2014-02-27 05:55:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 05:55:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 05:56:07 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 05:56:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 05:56:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 05:56:17 [DEBUG   ] Finished updating board flags in 1.374 seconds
2014-02-27 05:56:27 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2014-02-27 05:56:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 05:57:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 05:57:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 05:57:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 05:57:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 05:57:17 [DEBUG   ] Finished updating board flags in 1.356 seconds
2014-02-27 05:57:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 05:57:35 [DEBUG   ] Got command RPT from MCS: ref #289209
2014-02-27 05:57:35 [DEBUG   ] summary = ERROR
2014-02-27 05:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289209  13 56715 21455689 A  ERRORERROR'
2014-02-27 05:57:35 [DEBUG   ] Got command RPT from MCS: ref #289210
2014-02-27 05:57:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 05:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289210  77 56715 21455690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 05:57:47 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 05:58:07 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 05:58:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2014-02-27 05:58:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 05:58:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 05:58:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 05:58:18 [DEBUG   ] Finished updating board flags in 2.060 seconds
2014-02-27 05:58:28 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-27 05:58:48 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-27 05:59:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 05:59:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 05:59:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 05:59:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 05:59:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 05:59:18 [DEBUG   ] Finished updating board flags in 1.990 seconds
2014-02-27 05:59:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 05:59:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 06:00:08 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 06:00:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 06:00:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 06:00:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 06:00:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 06:00:18 [DEBUG   ] Finished updating board flags in 1.815 seconds
2014-02-27 06:00:28 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2014-02-27 06:00:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 06:01:08 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-27 06:01:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2014-02-27 06:01:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 06:01:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 06:01:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 06:01:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 06:01:18 [DEBUG   ] Finished updating board flags in 1.789 seconds
2014-02-27 06:01:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 06:01:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 06:02:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 06:02:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 06:02:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 06:02:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 06:02:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 06:02:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 06:02:18 [DEBUG   ] Finished updating board flags in 1.611 seconds
2014-02-27 06:02:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 06:02:35 [DEBUG   ] Got command RPT from MCS: ref #289226
2014-02-27 06:02:35 [DEBUG   ] summary = ERROR
2014-02-27 06:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289226  13 56715 21755689 A  ERRORERROR'
2014-02-27 06:02:35 [DEBUG   ] Got command RPT from MCS: ref #289227
2014-02-27 06:02:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 06:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289227  77 56715 21755690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 06:02:48 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 06:03:09 [DEBUG   ] Finished updating ant stats in 1.386 seconds
2014-02-27 06:03:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 06:03:18 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 06:03:18 [DEBUG   ] Finished updating board flags in 1.590 seconds
2014-02-27 06:03:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 06:03:49 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 06:04:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 06:04:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 06:04:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-02-27 06:04:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 06:04:18 [DEBUG   ] Finished updating board flags in 1.423 seconds
2014-02-27 06:04:29 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 06:04:49 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 06:05:09 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 06:05:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2014-02-27 06:05:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-02-27 06:05:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 06:05:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 06:05:18 [DEBUG   ] Finished updating board flags in 1.385 seconds
2014-02-27 06:05:30 [DEBUG   ] Finished updating ant stats in 1.602 seconds
2014-02-27 06:05:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 06:06:10 [DEBUG   ] Finished updating ant stats in 1.599 seconds
2014-02-27 06:06:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2014-02-27 06:06:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-02-27 06:06:18 [DEBUG   ] Finished updating board flags in 1.346 seconds
2014-02-27 06:06:30 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2014-02-27 06:06:50 [DEBUG   ] Finished updating ant stats in 1.408 seconds
2014-02-27 06:07:10 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-02-27 06:07:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 06:07:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 06:07:19 [DEBUG   ] Finished updating board flags in 2.072 seconds
2014-02-27 06:07:30 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-27 06:07:35 [DEBUG   ] Got command RPT from MCS: ref #289243
2014-02-27 06:07:35 [DEBUG   ] summary = ERROR
2014-02-27 06:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289243  13 56715 22055693 A  ERRORERROR'
2014-02-27 06:07:35 [DEBUG   ] Got command RPT from MCS: ref #289244
2014-02-27 06:07:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 06:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289244  77 56715 22055694 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 06:07:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 06:08:10 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 06:08:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 06:08:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-02-27 06:08:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 06:08:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 06:08:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 06:08:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 06:08:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 06:08:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 06:08:19 [DEBUG   ] Finished updating board flags in 1.985 seconds
2014-02-27 06:08:30 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 06:08:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 06:09:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2014-02-27 06:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2014-02-27 06:09:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 06:09:19 [DEBUG   ] Finished updating board flags in 1.829 seconds
2014-02-27 06:09:30 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 06:09:50 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 06:10:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-02-27 06:10:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-02-27 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-02-27 06:10:19 [DEBUG   ] Finished updating board flags in 1.807 seconds
2014-02-27 06:10:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 06:10:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 06:11:10 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 06:11:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 06:11:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 06:11:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 06:11:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 06:11:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 06:11:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 06:11:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 06:11:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-27 06:11:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 06:11:19 [DEBUG   ] Finished updating board flags in 1.778 seconds
2014-02-27 06:11:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 06:11:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 06:12:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 06:12:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 06:12:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 06:12:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 06:12:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 06:12:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 06:12:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 06:12:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 06:12:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 06:12:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 06:12:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 06:12:19 [DEBUG   ] Finished updating board flags in 1.615 seconds
2014-02-27 06:12:30 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 06:12:35 [DEBUG   ] Got command RPT from MCS: ref #289260
2014-02-27 06:12:35 [DEBUG   ] summary = ERROR
2014-02-27 06:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289260  13 56715 22355689 A  ERRORERROR'
2014-02-27 06:12:35 [DEBUG   ] Got command RPT from MCS: ref #289261
2014-02-27 06:12:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 06:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289261  77 56715 22355690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 06:12:51 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-02-27 06:13:11 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-27 06:13:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 06:13:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 06:13:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 06:13:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 06:13:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 06:13:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 06:13:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 06:13:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 06:13:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 06:13:19 [DEBUG   ] Finished updating board flags in 1.574 seconds
2014-02-27 06:13:31 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2014-02-27 06:13:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 06:14:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 06:14:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 06:14:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 06:14:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 06:14:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 06:14:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 06:14:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 06:14:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 06:14:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 06:14:19 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 06:14:19 [DEBUG   ] Finished updating board flags in 1.415 seconds
2014-02-27 06:14:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 06:14:51 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-27 06:15:11 [DEBUG   ] Finished updating ant stats in 0.742 seconds
2014-02-27 06:15:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 06:15:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 06:15:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 06:15:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 06:15:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 06:15:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 06:15:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 06:15:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 06:15:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 06:15:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 06:15:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 06:15:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 06:15:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 06:15:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 06:15:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 06:15:19 [DEBUG   ] Finished updating board flags in 1.398 seconds
2014-02-27 06:15:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 06:15:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 06:16:11 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 06:16:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 06:16:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 06:16:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 06:16:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 06:16:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 06:16:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 06:16:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 06:16:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 06:16:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 06:16:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 06:16:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 06:16:19 [DEBUG   ] Finished updating board flags in 1.366 seconds
2014-02-27 06:16:31 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 06:16:52 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-27 06:17:11 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-02-27 06:17:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 06:17:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 06:17:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 06:17:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 06:17:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 06:17:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 06:17:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 06:17:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 06:17:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 06:17:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 06:17:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 06:17:20 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 06:17:20 [DEBUG   ] Finished updating board flags in 2.053 seconds
2014-02-27 06:17:32 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2014-02-27 06:17:35 [DEBUG   ] Got command RPT from MCS: ref #289277
2014-02-27 06:17:35 [DEBUG   ] summary = ERROR
2014-02-27 06:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289277  13 56715 22655689 A  ERRORERROR'
2014-02-27 06:17:35 [DEBUG   ] Got command RPT from MCS: ref #289278
2014-02-27 06:17:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 06:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289278  77 56715 22655690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 06:17:52 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-27 06:18:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 06:18:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 06:18:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 06:18:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 06:18:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 06:18:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 06:18:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 06:18:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 06:18:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 06:18:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 06:18:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 06:18:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 06:18:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 06:18:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 06:18:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 06:18:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2014-02-27 06:18:20 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 06:18:20 [DEBUG   ] Finished updating board flags in 1.983 seconds
2014-02-27 06:18:32 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2014-02-27 06:18:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 06:19:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 06:19:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 06:19:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 06:19:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 06:19:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 06:19:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 06:19:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 06:19:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-27 06:19:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 06:19:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 06:19:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 06:19:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 06:19:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 06:19:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 06:19:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 06:19:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 06:19:20 [DEBUG   ] Finished updating board flags in 1.810 seconds
2014-02-27 06:19:32 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-27 06:19:52 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 06:20:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 06:20:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 06:20:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 06:20:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 06:20:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 06:20:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 06:20:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 06:20:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 06:20:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 06:20:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 06:20:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 06:20:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 06:20:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 06:20:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 06:20:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 06:20:20 [DEBUG   ] Finished updating board flags in 1.813 seconds
2014-02-27 06:20:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 06:20:52 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2014-02-27 06:21:12 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 06:21:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 06:21:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 06:21:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 06:21:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 06:21:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 06:21:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 06:21:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 06:21:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 06:21:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 06:21:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 06:21:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 06:21:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 06:21:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 06:21:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 06:21:20 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 06:21:20 [DEBUG   ] Finished updating board flags in 1.782 seconds
2014-02-27 06:21:32 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 06:21:53 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-27 06:22:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 06:22:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 06:22:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 06:22:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 06:22:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 06:22:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 06:22:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 06:22:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2014-02-27 06:22:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 06:22:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 06:22:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 06:22:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 06:22:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 06:22:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-27 06:22:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 06:22:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 06:22:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 06:22:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 06:22:20 [DEBUG   ] Finished updating board flags in 1.614 seconds
2014-02-27 06:22:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 06:22:35 [DEBUG   ] Got command RPT from MCS: ref #289294
2014-02-27 06:22:35 [DEBUG   ] summary = ERROR
2014-02-27 06:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289294  13 56715 22955701 A  ERRORERROR'
2014-02-27 06:22:35 [DEBUG   ] Got command RPT from MCS: ref #289295
2014-02-27 06:22:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 06:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289295  77 56715 22955702 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 06:22:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 06:23:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 06:23:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 06:23:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 06:23:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 06:23:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 06:23:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 06:23:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 06:23:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 06:23:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 06:23:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 06:23:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 06:23:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 06:23:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 06:23:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 06:23:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 06:23:20 [DEBUG   ] Finished updating board flags in 1.611 seconds
2014-02-27 06:23:33 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2014-02-27 06:23:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 06:24:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 06:24:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 06:24:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 06:24:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 06:24:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 06:24:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 06:24:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 06:24:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 06:24:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 06:24:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 06:24:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 06:24:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-02-27 06:24:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-02-27 06:24:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 06:24:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 06:24:20 [DEBUG   ] Finished updating board flags in 1.590 seconds
2014-02-27 06:24:33 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 06:24:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 06:25:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 06:25:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 06:25:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 06:25:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 06:25:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 06:25:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 06:25:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 06:25:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 06:25:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 06:25:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 06:25:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 06:25:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 06:25:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 06:25:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 06:25:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 06:25:20 [DEBUG   ] Finished updating board flags in 1.410 seconds
2014-02-27 06:25:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 06:25:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 06:26:13 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-02-27 06:26:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 06:26:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 06:26:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 06:26:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 06:26:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 06:26:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-27 06:26:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 06:26:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 06:26:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 06:26:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 06:26:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 06:26:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 06:26:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 06:26:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 06:26:20 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 06:26:20 [DEBUG   ] Finished updating board flags in 1.395 seconds
2014-02-27 06:26:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 06:26:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 06:27:13 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2014-02-27 06:27:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 06:27:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 06:27:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 06:27:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 06:27:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 06:27:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 06:27:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 06:27:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 06:27:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 06:27:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 06:27:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 06:27:20 [DEBUG   ] Finished updating board flags in 1.381 seconds
2014-02-27 06:27:33 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2014-02-27 06:27:35 [DEBUG   ] Got command RPT from MCS: ref #289311
2014-02-27 06:27:35 [DEBUG   ] summary = ERROR
2014-02-27 06:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289311  13 56715 23255697 A  ERRORERROR'
2014-02-27 06:27:35 [DEBUG   ] Got command RPT from MCS: ref #289312
2014-02-27 06:27:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 06:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289312  77 56715 23255698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 06:27:54 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 06:28:14 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2014-02-27 06:28:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 06:28:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 06:28:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 06:28:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 06:28:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 06:28:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 06:28:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 06:28:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 06:28:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 06:28:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 06:28:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 06:28:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 06:28:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 06:28:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 06:28:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 06:28:21 [DEBUG   ] Finished updating board flags in 2.041 seconds
2014-02-27 06:28:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 06:28:54 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-27 06:29:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 06:29:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 06:29:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 06:29:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 06:29:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 06:29:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 06:29:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 06:29:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 06:29:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 06:29:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 06:29:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 06:29:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 06:29:21 [DEBUG   ] Finished updating board flags in 1.980 seconds
2014-02-27 06:29:34 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 06:29:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 06:30:15 [DEBUG   ] Finished updating ant stats in 1.601 seconds
2014-02-27 06:30:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 06:30:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 06:30:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 06:30:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 06:30:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 06:30:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 06:30:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 06:30:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 06:30:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 06:30:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 06:30:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 06:30:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 06:30:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 06:30:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 06:30:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 06:30:21 [DEBUG   ] Finished updating board flags in 1.815 seconds
2014-02-27 06:30:34 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-27 06:30:54 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 06:31:15 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-02-27 06:31:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 06:31:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 06:31:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 06:31:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 06:31:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 06:31:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 06:31:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 06:31:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 06:31:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 06:31:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 06:31:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 06:31:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 06:31:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 06:31:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 06:31:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 06:31:21 [DEBUG   ] Finished updating board flags in 1.816 seconds
2014-02-27 06:31:35 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-27 06:31:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 06:32:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 06:32:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 06:32:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 06:32:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 06:32:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 06:32:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 06:32:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 06:32:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 06:32:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 06:32:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 06:32:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 06:32:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 06:32:21 [DEBUG   ] Finished updating board flags in 1.804 seconds
2014-02-27 06:32:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 06:32:35 [DEBUG   ] Got command RPT from MCS: ref #289328
2014-02-27 06:32:35 [DEBUG   ] summary = ERROR
2014-02-27 06:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289328  13 56715 23555697 A  ERRORERROR'
2014-02-27 06:32:35 [DEBUG   ] Got command RPT from MCS: ref #289329
2014-02-27 06:32:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 06:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289329  77 56715 23555698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 06:32:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 06:33:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 06:33:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 06:33:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 06:33:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 06:33:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 06:33:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 06:33:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 06:33:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 06:33:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 06:33:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 06:33:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 06:33:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 06:33:21 [DEBUG   ] Finished updating board flags in 1.850 seconds
2014-02-27 06:33:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 06:33:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 06:34:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2014-02-27 06:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2014-02-27 06:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2014-02-27 06:34:21 [DEBUG   ] Finished updating board flags in 1.840 seconds
2014-02-27 06:34:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 06:34:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 06:35:15 [DEBUG   ] Finished updating ant stats in 1.340 seconds
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-02-27 06:35:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-02-27 06:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-02-27 06:35:21 [DEBUG   ] Finished updating board flags in 1.690 seconds
2014-02-27 06:35:35 [DEBUG   ] Finished updating ant stats in 0.868 seconds
2014-02-27 06:35:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 06:36:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 06:36:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 06:36:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 06:36:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 06:36:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 06:36:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 06:36:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 06:36:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 06:36:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 06:36:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 06:36:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 06:36:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 06:36:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 06:36:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 06:36:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 06:36:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 06:36:21 [DEBUG   ] Finished updating board flags in 1.604 seconds
2014-02-27 06:36:35 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-02-27 06:36:55 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 06:37:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-27 06:37:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 06:37:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 06:37:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 06:37:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 06:37:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 06:37:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 06:37:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 06:37:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 06:37:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 06:37:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 06:37:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 06:37:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 06:37:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 06:37:21 [DEBUG   ] Finished updating board flags in 1.595 seconds
2014-02-27 06:37:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 06:37:35 [DEBUG   ] Got command RPT from MCS: ref #289345
2014-02-27 06:37:35 [DEBUG   ] summary = ERROR
2014-02-27 06:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289345  13 56715 23855701 A  ERRORERROR'
2014-02-27 06:37:35 [DEBUG   ] Got command RPT from MCS: ref #289346
2014-02-27 06:37:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 06:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289346  77 56715 23855702 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 06:37:56 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-27 06:38:15 [DEBUG   ] Finished updating ant stats in 0.408 seconds
2014-02-27 06:38:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 06:38:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 06:38:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 06:38:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 06:38:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 06:38:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 06:38:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 06:38:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 06:38:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 06:38:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 06:38:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 06:38:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 06:38:21 [DEBUG   ] Finished updating board flags in 1.440 seconds
2014-02-27 06:38:36 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2014-02-27 06:38:56 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-27 06:39:16 [DEBUG   ] Finished updating ant stats in 1.188 seconds
2014-02-27 06:39:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 06:39:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 06:39:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 06:39:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 06:39:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 06:39:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 06:39:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 06:39:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 06:39:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 06:39:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 06:39:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 06:39:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 06:39:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 06:39:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 06:39:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-02-27 06:39:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 06:39:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 06:39:21 [DEBUG   ] Finished updating board flags in 1.443 seconds
2014-02-27 06:39:36 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 06:39:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 06:40:16 [DEBUG   ] Finished updating ant stats in 1.140 seconds
2014-02-27 06:40:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 06:40:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 06:40:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 06:40:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 06:40:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 06:40:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 06:40:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 06:40:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 06:40:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 06:40:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 06:40:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 06:40:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 06:40:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 06:40:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 06:40:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2014-02-27 06:40:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 06:40:21 [DEBUG   ] Finished updating board flags in 1.474 seconds
2014-02-27 06:40:36 [DEBUG   ] Finished updating ant stats in 0.664 seconds
2014-02-27 06:40:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 06:41:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 06:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 06:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 06:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 06:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 06:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 06:41:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 06:41:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 06:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 06:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 06:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 06:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 06:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 06:41:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 06:41:21 [DEBUG   ] Finished updating board flags in 1.440 seconds
2014-02-27 06:41:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 06:41:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 06:42:16 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 06:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 06:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 06:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 06:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 06:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 06:42:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 06:42:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 06:42:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 06:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 06:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 06:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 06:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 06:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 06:42:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 06:42:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 06:42:21 [DEBUG   ] Finished updating board flags in 1.442 seconds
2014-02-27 06:42:35 [DEBUG   ] Got command RPT from MCS: ref #289362
2014-02-27 06:42:35 [DEBUG   ] summary = ERROR
2014-02-27 06:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289362  13 56715 24155705 A  ERRORERROR'
2014-02-27 06:42:35 [DEBUG   ] Got command RPT from MCS: ref #289363
2014-02-27 06:42:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 06:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289363  77 56715 24155706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 06:42:36 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2014-02-27 06:42:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 06:43:17 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-02-27 06:43:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 06:43:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 06:43:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 06:43:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 06:43:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 06:43:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 06:43:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 06:43:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 06:43:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 06:43:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 06:43:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 06:43:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 06:43:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 06:43:22 [DEBUG   ] Finished updating board flags in 2.192 seconds
2014-02-27 06:43:37 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-27 06:43:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 06:44:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 06:44:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 06:44:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 06:44:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 06:44:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 06:44:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 06:44:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 06:44:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 06:44:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 06:44:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 06:44:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 06:44:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 06:44:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 06:44:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 06:44:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 06:44:22 [DEBUG   ] Finished updating board flags in 1.976 seconds
2014-02-27 06:44:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 06:44:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 06:45:17 [DEBUG   ] Finished updating ant stats in 1.536 seconds
2014-02-27 06:45:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 06:45:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 06:45:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 06:45:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 06:45:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 06:45:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-27 06:45:21 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 06:45:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 06:45:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 06:45:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 06:45:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 06:45:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 06:45:22 [DEBUG   ] Finished updating board flags in 1.809 seconds
2014-02-27 06:45:37 [DEBUG   ] Finished updating ant stats in 1.064 seconds
2014-02-27 06:45:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 06:46:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 06:46:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 06:46:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 06:46:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 06:46:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 06:46:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 06:46:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2014-02-27 06:46:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2014-02-27 06:46:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 06:46:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 06:46:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 06:46:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 06:46:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 06:46:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 06:46:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 06:46:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 06:46:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 06:46:22 [DEBUG   ] Finished updating board flags in 1.786 seconds
2014-02-27 06:46:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 06:46:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 06:47:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 06:47:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 06:47:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 06:47:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 06:47:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 06:47:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 06:47:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 06:47:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 06:47:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 06:47:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 06:47:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 06:47:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 06:47:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 06:47:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 06:47:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 06:47:22 [DEBUG   ] Finished updating board flags in 1.708 seconds
2014-02-27 06:47:35 [DEBUG   ] Got command RPT from MCS: ref #289379
2014-02-27 06:47:35 [DEBUG   ] summary = ERROR
2014-02-27 06:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289379  13 56715 24455705 A  ERRORERROR'
2014-02-27 06:47:35 [DEBUG   ] Got command RPT from MCS: ref #289380
2014-02-27 06:47:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 06:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289380  77 56715 24455706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 06:47:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 06:47:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 06:48:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 06:48:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 06:48:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 06:48:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 06:48:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 06:48:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 06:48:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 06:48:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 06:48:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 06:48:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 06:48:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 06:48:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 06:48:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 06:48:22 [DEBUG   ] Finished updating board flags in 1.492 seconds
2014-02-27 06:48:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 06:48:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 06:49:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 06:49:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 06:49:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 06:49:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 06:49:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 06:49:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 06:49:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 06:49:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 06:49:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2014-02-27 06:49:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 06:49:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 06:49:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 06:49:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 06:49:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 06:49:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 06:49:22 [DEBUG   ] Finished updating board flags in 1.433 seconds
2014-02-27 06:49:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 06:49:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 06:50:17 [DEBUG   ] Finished updating ant stats in 1.245 seconds
2014-02-27 06:50:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 06:50:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 06:50:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 06:50:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 06:50:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 06:50:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 06:50:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2014-02-27 06:50:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 06:50:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2014-02-27 06:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 06:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 06:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 06:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 06:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 06:50:22 [DEBUG   ] Finished updating board flags in 1.501 seconds
2014-02-27 06:50:37 [DEBUG   ] Finished updating ant stats in 0.958 seconds
2014-02-27 06:50:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 06:51:17 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 06:51:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 06:51:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 06:51:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 06:51:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 06:51:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 06:51:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 06:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 06:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 06:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 06:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 06:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 06:51:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 06:51:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-02-27 06:51:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 06:51:22 [DEBUG   ] Finished updating board flags in 1.498 seconds
2014-02-27 06:51:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 06:51:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 06:52:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 06:52:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 06:52:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 06:52:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 06:52:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 06:52:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 06:52:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 06:52:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 06:52:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 06:52:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 06:52:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 06:52:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 06:52:23 [DEBUG   ] Finished updating board flags in 2.213 seconds
2014-02-27 06:52:35 [DEBUG   ] Got command RPT from MCS: ref #289396
2014-02-27 06:52:35 [DEBUG   ] summary = ERROR
2014-02-27 06:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289396  13 56715 24755697 A  ERRORERROR'
2014-02-27 06:52:35 [DEBUG   ] Got command RPT from MCS: ref #289397
2014-02-27 06:52:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 06:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289397  77 56715 24755698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 06:52:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 06:52:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 06:53:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 06:53:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 06:53:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 06:53:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 06:53:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 06:53:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 06:53:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 06:53:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 06:53:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 06:53:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 06:53:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 06:53:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 06:53:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 06:53:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 06:53:23 [DEBUG   ] Finished updating board flags in 2.282 seconds
2014-02-27 06:53:37 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 06:53:57 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2014-02-27 06:54:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 06:54:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 06:54:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 06:54:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 06:54:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 06:54:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 06:54:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 06:54:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 06:54:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 06:54:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 06:54:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 06:54:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 06:54:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 06:54:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 06:54:23 [DEBUG   ] Finished updating board flags in 2.086 seconds
2014-02-27 06:54:38 [DEBUG   ] Finished updating ant stats in 1.391 seconds
2014-02-27 06:54:58 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-27 06:55:18 [DEBUG   ] Finished updating ant stats in 1.542 seconds
2014-02-27 06:55:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 06:55:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 06:55:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 06:55:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 06:55:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 06:55:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-02-27 06:55:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 06:55:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 06:55:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 06:55:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 06:55:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 06:55:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 06:55:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 06:55:23 [DEBUG   ] Finished updating board flags in 2.021 seconds
2014-02-27 06:55:38 [DEBUG   ] Finished updating ant stats in 1.064 seconds
2014-02-27 06:55:58 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-27 06:56:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 06:56:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 06:56:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 06:56:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 06:56:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 06:56:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 06:56:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 06:56:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-02-27 06:56:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 06:56:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 06:56:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 06:56:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 06:56:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 06:56:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 06:56:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 06:56:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 06:56:23 [DEBUG   ] Finished updating board flags in 1.982 seconds
2014-02-27 06:56:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 06:56:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 06:57:18 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-02-27 06:57:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 06:57:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 06:57:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 06:57:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 06:57:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 06:57:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 06:57:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 06:57:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 06:57:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 06:57:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 06:57:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 06:57:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 06:57:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 06:57:23 [DEBUG   ] Finished updating board flags in 1.809 seconds
2014-02-27 06:57:35 [DEBUG   ] Got command RPT from MCS: ref #289413
2014-02-27 06:57:35 [DEBUG   ] summary = ERROR
2014-02-27 06:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289413  13 56715 25055701 A  ERRORERROR'
2014-02-27 06:57:35 [DEBUG   ] Got command RPT from MCS: ref #289414
2014-02-27 06:57:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 06:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289414  77 56715 25055702 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 06:57:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-27 06:57:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 06:58:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 06:58:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 06:58:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 06:58:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 06:58:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 06:58:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 06:58:22 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 06:58:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 06:58:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 06:58:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 06:58:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 06:58:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 06:58:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2014-02-27 06:58:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 06:58:23 [DEBUG   ] Finished updating board flags in 1.783 seconds
2014-02-27 06:58:38 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-02-27 06:58:59 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-02-27 06:59:19 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-27 06:59:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 06:59:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 06:59:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 06:59:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 06:59:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 06:59:22 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 06:59:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 06:59:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 06:59:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 06:59:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 06:59:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 06:59:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 06:59:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 06:59:23 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 06:59:23 [DEBUG   ] Finished updating board flags in 1.624 seconds
2014-02-27 06:59:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 06:59:59 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2014-02-27 07:00:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 07:00:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 07:00:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 07:00:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 07:00:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 07:00:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 07:00:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 07:00:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 07:00:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 07:00:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 07:00:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 07:00:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 07:00:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 07:00:23 [DEBUG   ] Finished updating board flags in 1.595 seconds
2014-02-27 07:00:39 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 07:00:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 07:01:19 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-02-27 07:01:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 07:01:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 07:01:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 07:01:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 07:01:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 07:01:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 07:01:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2014-02-27 07:01:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 07:01:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 07:01:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 07:01:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 07:01:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 07:01:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 07:01:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 07:01:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 07:01:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 07:01:23 [DEBUG   ] Finished updating board flags in 1.405 seconds
2014-02-27 07:01:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 07:01:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 07:02:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 07:02:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 07:02:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 07:02:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 07:02:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 07:02:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 07:02:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 07:02:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 07:02:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 07:02:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 07:02:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 07:02:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 07:02:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 07:02:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 07:02:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 07:02:23 [DEBUG   ] Finished updating board flags in 1.400 seconds
2014-02-27 07:02:35 [DEBUG   ] Got command RPT from MCS: ref #289430
2014-02-27 07:02:35 [DEBUG   ] summary = ERROR
2014-02-27 07:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289430  13 56715 25355705 A  ERRORERROR'
2014-02-27 07:02:35 [DEBUG   ] Got command RPT from MCS: ref #289431
2014-02-27 07:02:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 07:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289431  77 56715 25355706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 07:02:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-27 07:02:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 07:03:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 07:03:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 07:03:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 07:03:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 07:03:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 07:03:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 07:03:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 07:03:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 07:03:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 07:03:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 07:03:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 07:03:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 07:03:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 07:03:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 07:03:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 07:03:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 07:03:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 07:03:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 07:03:24 [DEBUG   ] Finished updating board flags in 2.205 seconds
2014-02-27 07:03:40 [DEBUG   ] Finished updating ant stats in 1.600 seconds
2014-02-27 07:04:00 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-02-27 07:04:20 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-27 07:04:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 07:04:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 07:04:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 07:04:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 07:04:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 07:04:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 07:04:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 07:04:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 07:04:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 07:04:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 07:04:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 07:04:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-02-27 07:04:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 07:04:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 07:04:24 [DEBUG   ] Finished updating board flags in 2.187 seconds
2014-02-27 07:04:40 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 07:05:00 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 07:05:20 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-27 07:05:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 07:05:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 07:05:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 07:05:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 07:05:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 07:05:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-27 07:05:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 07:05:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 07:05:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 07:05:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 07:05:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 07:05:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 07:05:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 07:05:24 [DEBUG   ] Finished updating board flags in 2.019 seconds
2014-02-27 07:05:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 07:06:00 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 07:06:20 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-27 07:06:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 07:06:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 07:06:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 07:06:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 07:06:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 07:06:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2014-02-27 07:06:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 07:06:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 07:06:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 07:06:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 07:06:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 07:06:24 [DEBUG   ] Finished updating board flags in 1.987 seconds
2014-02-27 07:06:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 07:07:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 07:07:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 07:07:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 07:07:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 07:07:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 07:07:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 07:07:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 07:07:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2014-02-27 07:07:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 07:07:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 07:07:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 07:07:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 07:07:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 07:07:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 07:07:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 07:07:24 [DEBUG   ] Finished updating board flags in 1.857 seconds
2014-02-27 07:07:35 [DEBUG   ] Got command RPT from MCS: ref #289447
2014-02-27 07:07:35 [DEBUG   ] summary = ERROR
2014-02-27 07:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289447  13 56715 25655701 A  ERRORERROR'
2014-02-27 07:07:35 [DEBUG   ] Got command RPT from MCS: ref #289448
2014-02-27 07:07:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 07:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289448  77 56715 25655702 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 07:07:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 07:08:00 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 07:08:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 07:08:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 07:08:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 07:08:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 07:08:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 07:08:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 07:08:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 07:08:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 07:08:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 07:08:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 07:08:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 07:08:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 07:08:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 07:08:24 [DEBUG   ] Finished updating board flags in 1.748 seconds
2014-02-27 07:08:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 07:09:00 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-02-27 07:09:21 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-02-27 07:09:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 07:09:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 07:09:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 07:09:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 07:09:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 07:09:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 07:09:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 07:09:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 07:09:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 07:09:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 07:09:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 07:09:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 07:09:24 [DEBUG   ] Finished updating board flags in 1.612 seconds
2014-02-27 07:09:41 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-27 07:10:01 [DEBUG   ] Finished updating ant stats in 1.579 seconds
2014-02-27 07:10:21 [DEBUG   ] Finished updating ant stats in 1.365 seconds
2014-02-27 07:10:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 07:10:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 07:10:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 07:10:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 07:10:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 07:10:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 07:10:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 07:10:25 [DEBUG   ] Finished updating board flags in 2.792 seconds
2014-02-27 07:10:41 [DEBUG   ] Finished updating ant stats in 0.863 seconds
2014-02-27 07:11:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 07:11:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 07:11:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 07:11:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 07:11:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 07:11:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 07:11:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 07:11:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2014-02-27 07:11:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 07:11:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 07:11:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 07:11:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 07:11:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 07:11:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 07:11:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-02-27 07:11:24 [DEBUG   ] Finished updating board flags in 1.387 seconds
2014-02-27 07:11:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 07:12:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-27 07:12:21 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-02-27 07:12:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 07:12:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 07:12:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 07:12:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 07:12:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 07:12:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 07:12:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 07:12:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 07:12:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 07:12:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 07:12:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 07:12:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 07:12:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 07:12:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 07:12:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-02-27 07:12:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 07:12:24 [DEBUG   ] Finished updating board flags in 1.457 seconds
2014-02-27 07:12:35 [DEBUG   ] Got command RPT from MCS: ref #289464
2014-02-27 07:12:35 [DEBUG   ] summary = ERROR
2014-02-27 07:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289464  13 56715 25955705 A  ERRORERROR'
2014-02-27 07:12:35 [DEBUG   ] Got command RPT from MCS: ref #289465
2014-02-27 07:12:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 07:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289465  77 56715 25955706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 07:12:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 07:13:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 07:13:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 07:13:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 07:13:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 07:13:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 07:13:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 07:13:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 07:13:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 07:13:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 07:13:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 07:13:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 07:13:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 07:13:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 07:13:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 07:13:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 07:13:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 07:13:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 07:13:25 [DEBUG   ] Finished updating board flags in 2.226 seconds
2014-02-27 07:13:41 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-27 07:14:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 07:14:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 07:14:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 07:14:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 07:14:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 07:14:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 07:14:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 07:14:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 07:14:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 07:14:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 07:14:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 07:14:25 [DEBUG   ] Finished updating board flags in 2.210 seconds
2014-02-27 07:14:41 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-27 07:15:02 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-02-27 07:15:22 [DEBUG   ] Finished updating ant stats in 1.294 seconds
2014-02-27 07:15:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 07:15:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 07:15:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 07:15:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 07:15:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 07:15:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2014-02-27 07:15:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 07:15:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-02-27 07:15:25 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 07:15:25 [DEBUG   ] Finished updating board flags in 2.129 seconds
2014-02-27 07:15:42 [DEBUG   ] Finished updating ant stats in 1.114 seconds
2014-02-27 07:16:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 07:16:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 07:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 07:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 07:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 07:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 07:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 07:16:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 07:16:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 07:16:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 07:16:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 07:16:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 07:16:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 07:16:25 [DEBUG   ] Finished updating board flags in 2.005 seconds
2014-02-27 07:16:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 07:17:03 [DEBUG   ] Finished updating ant stats in 1.999 seconds
2014-02-27 07:17:22 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-27 07:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 07:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 07:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 07:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 07:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 07:17:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 07:17:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 07:17:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 07:17:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 07:17:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 07:17:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 07:17:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 07:17:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 07:17:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 07:17:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 07:17:25 [DEBUG   ] Finished updating board flags in 1.987 seconds
2014-02-27 07:17:35 [DEBUG   ] Got command RPT from MCS: ref #289481
2014-02-27 07:17:35 [DEBUG   ] summary = ERROR
2014-02-27 07:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289481  13 56715 26255709 A  ERRORERROR'
2014-02-27 07:17:35 [DEBUG   ] Got command RPT from MCS: ref #289482
2014-02-27 07:17:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 07:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289482  77 56715 26255710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 07:17:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 07:18:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 07:18:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 07:18:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 07:18:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 07:18:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 07:18:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 07:18:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 07:18:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-02-27 07:18:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 07:18:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 07:18:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 07:18:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 07:18:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 07:18:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 07:18:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 07:18:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 07:18:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 07:18:25 [DEBUG   ] Finished updating board flags in 1.827 seconds
2014-02-27 07:18:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 07:19:02 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-02-27 07:19:22 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 07:19:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 07:19:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 07:19:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 07:19:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 07:19:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 07:19:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 07:19:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 07:19:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 07:19:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 07:19:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 07:19:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 07:19:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 07:19:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 07:19:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 07:19:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2014-02-27 07:19:25 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 07:19:25 [DEBUG   ] Finished updating board flags in 1.781 seconds
2014-02-27 07:19:43 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-02-27 07:20:03 [DEBUG   ] Finished updating ant stats in 1.566 seconds
2014-02-27 07:20:23 [DEBUG   ] Finished updating ant stats in 1.043 seconds
2014-02-27 07:20:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 07:20:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 07:20:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 07:20:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 07:20:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 07:20:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 07:20:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 07:20:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 07:20:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 07:20:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 07:20:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 07:20:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 07:20:25 [DEBUG   ] Finished updating board flags in 1.618 seconds
2014-02-27 07:20:43 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-27 07:21:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 07:21:23 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 07:21:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 07:21:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 07:21:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 07:21:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 07:21:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 07:21:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 07:21:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2014-02-27 07:21:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 07:21:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 07:21:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 07:21:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 07:21:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 07:21:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 07:21:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 07:21:25 [DEBUG   ] Finished updating board flags in 1.582 seconds
2014-02-27 07:21:43 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 07:22:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 07:22:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-27 07:22:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 07:22:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 07:22:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 07:22:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 07:22:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 07:22:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 07:22:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 07:22:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 07:22:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 07:22:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 07:22:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 07:22:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-02-27 07:22:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 07:22:25 [DEBUG   ] Finished updating board flags in 1.414 seconds
2014-02-27 07:22:35 [DEBUG   ] Got command RPT from MCS: ref #289498
2014-02-27 07:22:35 [DEBUG   ] summary = ERROR
2014-02-27 07:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289498  13 56715 26555709 A  ERRORERROR'
2014-02-27 07:22:35 [DEBUG   ] Got command RPT from MCS: ref #289499
2014-02-27 07:22:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 07:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289499  77 56715 26555710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 07:22:43 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 07:23:04 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-02-27 07:23:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 07:23:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 07:23:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 07:23:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 07:23:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 07:23:24 [DEBUG   ] Finished updating ant stats in 1.252 seconds
2014-02-27 07:23:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 07:23:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 07:23:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 07:23:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 07:23:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 07:23:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 07:23:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 07:23:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 07:23:25 [DEBUG   ] Finished updating board flags in 1.406 seconds
2014-02-27 07:23:44 [DEBUG   ] Finished updating ant stats in 1.154 seconds
2014-02-27 07:24:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 07:24:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 07:24:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 07:24:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 07:24:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 07:24:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 07:24:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 07:24:24 [DEBUG   ] Finished updating ant stats in 1.048 seconds
2014-02-27 07:24:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 07:24:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 07:24:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 07:24:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 07:24:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 07:24:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 07:24:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 07:24:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 07:24:25 [DEBUG   ] Finished updating board flags in 1.398 seconds
2014-02-27 07:24:44 [DEBUG   ] Finished updating ant stats in 0.953 seconds
2014-02-27 07:25:04 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2014-02-27 07:25:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 07:25:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 07:25:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 07:25:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 07:25:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 07:25:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 07:25:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 07:25:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 07:25:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2014-02-27 07:25:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 07:25:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 07:25:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 07:25:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 07:25:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 07:25:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 07:25:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-02-27 07:25:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 07:25:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 5
2014-02-27 07:25:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 07:25:25 [DEBUG   ] Finished updating board flags in 1.354 seconds
2014-02-27 07:25:44 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-02-27 07:26:05 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-02-27 07:26:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 07:26:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 07:26:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 07:26:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 07:26:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 07:26:25 [DEBUG   ] Finished updating ant stats in 1.254 seconds
2014-02-27 07:26:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 07:26:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2014-02-27 07:26:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 07:26:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 07:26:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 07:26:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 07:26:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 07:26:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 07:26:26 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 07:26:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2014-02-27 07:26:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 07:26:26 [DEBUG   ] Finished updating board flags in 2.054 seconds
2014-02-27 07:26:45 [DEBUG   ] Finished updating ant stats in 1.154 seconds
2014-02-27 07:27:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 07:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 07:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 07:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 07:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 07:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 07:27:25 [DEBUG   ] Finished updating ant stats in 1.050 seconds
2014-02-27 07:27:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 07:27:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 07:27:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 07:27:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 07:27:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 07:27:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 07:27:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 07:27:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 07:27:26 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 07:27:26 [DEBUG   ] Finished updating board flags in 1.988 seconds
2014-02-27 07:27:35 [DEBUG   ] Got command RPT from MCS: ref #289515
2014-02-27 07:27:35 [DEBUG   ] summary = ERROR
2014-02-27 07:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289515  13 56715 26855705 A  ERRORERROR'
2014-02-27 07:27:35 [DEBUG   ] Got command RPT from MCS: ref #289516
2014-02-27 07:27:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 07:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289516  77 56715 26855706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 07:27:45 [DEBUG   ] Finished updating ant stats in 0.955 seconds
2014-02-27 07:28:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 07:28:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 07:28:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 07:28:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 07:28:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 07:28:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 07:28:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 07:28:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 07:28:25 [DEBUG   ] Finished updating ant stats in 0.849 seconds
2014-02-27 07:28:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 07:28:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 07:28:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 07:28:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 07:28:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 07:28:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 07:28:26 [DEBUG   ] Finished updating board flags in 1.825 seconds
2014-02-27 07:28:45 [DEBUG   ] Finished updating ant stats in 0.751 seconds
2014-02-27 07:29:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 07:29:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 07:29:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 07:29:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 07:29:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 07:29:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 07:29:25 [DEBUG   ] Finished updating ant stats in 0.644 seconds
2014-02-27 07:29:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 07:29:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 07:29:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 07:29:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 07:29:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 07:29:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 07:29:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 07:29:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 07:29:26 [DEBUG   ] Finished updating board flags in 1.782 seconds
2014-02-27 07:29:45 [DEBUG   ] Finished updating ant stats in 0.557 seconds
2014-02-27 07:30:06 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2014-02-27 07:30:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 07:30:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 07:30:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 07:30:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 07:30:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 07:30:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-02-27 07:30:25 [DEBUG   ] Finished updating ant stats in 0.449 seconds
2014-02-27 07:30:25 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 07:30:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 07:30:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 07:30:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 07:30:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 07:30:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 07:30:26 [DEBUG   ] Finished updating board flags in 1.617 seconds
2014-02-27 07:30:46 [DEBUG   ] Finished updating ant stats in 1.355 seconds
2014-02-27 07:31:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 07:31:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 07:31:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 07:31:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 07:31:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 07:31:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 07:31:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2014-02-27 07:31:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 07:31:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-27 07:31:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 07:31:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 07:31:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 07:31:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 07:31:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 07:31:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 07:31:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 07:31:26 [DEBUG   ] Finished updating ant stats in 1.246 seconds
2014-02-27 07:31:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 07:31:26 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 07:31:26 [DEBUG   ] Finished updating board flags in 1.653 seconds
2014-02-27 07:31:46 [DEBUG   ] Finished updating ant stats in 1.157 seconds
2014-02-27 07:32:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 07:32:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 07:32:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 07:32:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 07:32:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 07:32:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 07:32:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 07:32:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 07:32:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 07:32:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 07:32:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 07:32:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 07:32:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 07:32:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 07:32:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 07:32:26 [DEBUG   ] Finished updating ant stats in 1.047 seconds
2014-02-27 07:32:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 07:32:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 07:32:26 [DEBUG   ] Finished updating board flags in 1.613 seconds
2014-02-27 07:32:35 [DEBUG   ] Got command RPT from MCS: ref #289532
2014-02-27 07:32:35 [DEBUG   ] summary = ERROR
2014-02-27 07:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289532  13 56715 27155705 A  ERRORERROR'
2014-02-27 07:32:35 [DEBUG   ] Got command RPT from MCS: ref #289533
2014-02-27 07:32:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 07:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289533  77 56715 27155706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 07:32:46 [DEBUG   ] Finished updating ant stats in 0.959 seconds
2014-02-27 07:33:06 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2014-02-27 07:33:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 07:33:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 07:33:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 07:33:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 07:33:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 07:33:25 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 07:33:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 07:33:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 07:33:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 07:33:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 07:33:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 07:33:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 07:33:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 07:33:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 07:33:26 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2014-02-27 07:33:26 [DEBUG   ] Finished updating board flags in 1.582 seconds
2014-02-27 07:33:46 [DEBUG   ] Finished updating ant stats in 0.560 seconds
2014-02-27 07:34:07 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-02-27 07:34:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 07:34:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 07:34:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 07:34:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 07:34:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 07:34:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 07:34:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 07:34:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 07:34:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 07:34:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 07:34:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 07:34:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2014-02-27 07:34:26 [DEBUG   ] Finished updating board flags in 1.463 seconds
2014-02-27 07:34:27 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-27 07:34:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 07:35:07 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-27 07:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 07:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 07:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 07:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 07:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 07:35:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 07:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 07:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 07:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 07:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 07:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 07:35:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 07:35:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 07:35:26 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 07:35:26 [DEBUG   ] Finished updating board flags in 1.461 seconds
2014-02-27 07:35:27 [DEBUG   ] Finished updating ant stats in 1.193 seconds
2014-02-27 07:35:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 07:36:07 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2014-02-27 07:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2014-02-27 07:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2014-02-27 07:36:26 [DEBUG   ] Finished updating board flags in 1.490 seconds
2014-02-27 07:36:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 07:36:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 07:37:07 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-02-27 07:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-02-27 07:37:27 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-02-27 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-02-27 07:37:27 [DEBUG   ] Finished updating board flags in 2.233 seconds
2014-02-27 07:37:35 [DEBUG   ] Got command RPT from MCS: ref #289549
2014-02-27 07:37:35 [DEBUG   ] summary = ERROR
2014-02-27 07:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289549  13 56715 27455717 A  ERRORERROR'
2014-02-27 07:37:35 [DEBUG   ] Got command RPT from MCS: ref #289550
2014-02-27 07:37:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 07:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289550  77 56715 27455718 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 07:37:47 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2014-02-27 07:38:08 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-02-27 07:38:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 07:38:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 07:38:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 07:38:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 07:38:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 07:38:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 07:38:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 07:38:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 07:38:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 07:38:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 07:38:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 07:38:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 07:38:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 07:38:27 [DEBUG   ] Finished updating board flags in 2.156 seconds
2014-02-27 07:38:28 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-27 07:38:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 07:39:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-27 07:39:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 07:39:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 07:39:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 07:39:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 07:39:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 07:39:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 07:39:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 07:39:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 07:39:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 07:39:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 07:39:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 07:39:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 07:39:28 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 07:39:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 07:39:28 [DEBUG   ] Finished updating board flags in 3.104 seconds
2014-02-27 07:39:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 07:40:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 07:40:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 07:40:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 07:40:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 07:40:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 07:40:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 07:40:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 07:40:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 07:40:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 07:40:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 07:40:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 07:40:27 [DEBUG   ] Finished updating board flags in 1.896 seconds
2014-02-27 07:40:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 07:40:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 07:41:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 07:41:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 07:41:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 07:41:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 07:41:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 07:41:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 07:41:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 07:41:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 07:41:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 07:41:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 07:41:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 07:41:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 07:41:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 07:41:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 07:41:27 [DEBUG   ] Finished updating board flags in 1.845 seconds
2014-02-27 07:41:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 07:41:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 07:42:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 07:42:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 07:42:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 07:42:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 07:42:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 07:42:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 07:42:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 07:42:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 07:42:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-27 07:42:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 07:42:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 07:42:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 07:42:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 07:42:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 07:42:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 07:42:28 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-27 07:42:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 07:42:28 [DEBUG   ] Finished updating board flags in 2.721 seconds
2014-02-27 07:42:35 [DEBUG   ] Got command RPT from MCS: ref #289566
2014-02-27 07:42:35 [DEBUG   ] summary = ERROR
2014-02-27 07:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289566  13 56715 27755709 A  ERRORERROR'
2014-02-27 07:42:35 [DEBUG   ] Got command RPT from MCS: ref #289567
2014-02-27 07:42:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 07:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289567  77 56715 27755710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 07:42:48 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-27 07:43:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 07:43:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 07:43:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 07:43:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 07:43:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 07:43:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 07:43:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 07:43:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 07:43:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 07:43:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 07:43:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 07:43:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 07:43:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 07:43:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 07:43:27 [DEBUG   ] Finished updating board flags in 1.645 seconds
2014-02-27 07:43:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 07:43:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 07:44:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 07:44:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 07:44:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 07:44:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 07:44:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 07:44:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 07:44:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 07:44:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 07:44:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 07:44:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 07:44:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 07:44:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 07:44:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 07:44:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 07:44:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 07:44:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 07:44:27 [DEBUG   ] Finished updating board flags in 1.619 seconds
2014-02-27 07:44:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 07:44:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 07:45:08 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 07:45:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 07:45:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 07:45:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 07:45:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 07:45:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 07:45:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 07:45:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 07:45:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 07:45:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 07:45:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 07:45:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 07:45:27 [DEBUG   ] Finished updating board flags in 1.538 seconds
2014-02-27 07:45:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 07:45:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-27 07:46:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 07:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 07:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 07:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 07:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 07:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 07:46:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 07:46:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 07:46:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 07:46:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 07:46:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 07:46:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 07:46:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 07:46:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 07:46:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 07:46:27 [DEBUG   ] Finished updating board flags in 1.466 seconds
2014-02-27 07:46:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 07:46:48 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-02-27 07:47:09 [DEBUG   ] Finished updating ant stats in 1.390 seconds
2014-02-27 07:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 07:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 07:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 07:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 07:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 07:47:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 07:47:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 07:47:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 07:47:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 07:47:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 07:47:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 07:47:27 [DEBUG   ] Finished updating board flags in 1.464 seconds
2014-02-27 07:47:29 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-27 07:47:35 [DEBUG   ] Got command RPT from MCS: ref #289583
2014-02-27 07:47:35 [DEBUG   ] summary = ERROR
2014-02-27 07:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289583  13 56715 28055718 A  ERRORERROR'
2014-02-27 07:47:35 [DEBUG   ] Got command RPT from MCS: ref #289584
2014-02-27 07:47:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 07:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289584  77 56715 28055718 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 07:47:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-27 07:48:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 07:48:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 07:48:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 07:48:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 07:48:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 07:48:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 07:48:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 07:48:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 07:48:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 07:48:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 07:48:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 07:48:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 07:48:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 07:48:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 07:48:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 07:48:27 [DEBUG   ] Finished updating board flags in 1.472 seconds
2014-02-27 07:48:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 07:48:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 07:49:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-27 07:49:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 07:49:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 07:49:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 07:49:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 07:49:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 07:49:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 07:49:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 07:49:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 07:49:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 07:49:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 07:49:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 07:49:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 07:49:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 07:49:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 07:49:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 07:49:27 [DEBUG   ] Finished updating board flags in 1.554 seconds
2014-02-27 07:49:29 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2014-02-27 07:49:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 07:50:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 07:50:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 07:50:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 07:50:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 07:50:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 07:50:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 07:50:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 07:50:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 07:50:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 07:50:28 [DEBUG   ] Finished updating board flags in 2.140 seconds
2014-02-27 07:50:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 07:50:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 07:51:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 07:51:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 07:51:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 07:51:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 07:51:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 07:51:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 07:51:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 07:51:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 07:51:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 07:51:28 [DEBUG   ] Finished updating board flags in 1.993 seconds
2014-02-27 07:51:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 07:51:49 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 07:52:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 07:52:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 07:52:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 07:52:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 07:52:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 07:52:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 07:52:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 07:52:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 07:52:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 07:52:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 07:52:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 07:52:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 07:52:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2014-02-27 07:52:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 07:52:28 [DEBUG   ] Finished updating board flags in 1.867 seconds
2014-02-27 07:52:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 07:52:35 [DEBUG   ] Got command RPT from MCS: ref #289600
2014-02-27 07:52:35 [DEBUG   ] summary = ERROR
2014-02-27 07:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289600  13 56715 28355717 A  ERRORERROR'
2014-02-27 07:52:35 [DEBUG   ] Got command RPT from MCS: ref #289601
2014-02-27 07:52:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 07:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289601  77 56715 28355718 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 07:52:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 07:53:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 07:53:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 07:53:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 07:53:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 07:53:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 07:53:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 07:53:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 07:53:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-02-27 07:53:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 07:53:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 07:53:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 07:53:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 07:53:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 07:53:28 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 07:53:28 [DEBUG   ] Finished updating board flags in 1.697 seconds
2014-02-27 07:53:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 07:53:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 07:54:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 07:54:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 07:54:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 07:54:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 07:54:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 07:54:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 07:54:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 07:54:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 07:54:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 07:54:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 07:54:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 07:54:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 07:54:28 [DEBUG   ] Finished updating board flags in 1.613 seconds
2014-02-27 07:54:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 07:54:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 07:55:09 [DEBUG   ] Finished updating ant stats in 0.991 seconds
2014-02-27 07:55:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 07:55:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 07:55:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 07:55:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 07:55:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 07:55:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 07:55:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 07:55:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 07:55:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 07:55:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 07:55:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 07:55:28 [DEBUG   ] Finished updating board flags in 1.566 seconds
2014-02-27 07:55:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 07:55:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 07:56:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 07:56:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 07:56:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 07:56:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 07:56:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 07:56:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 07:56:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 07:56:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 07:56:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 07:56:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 07:56:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 07:56:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 07:56:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 07:56:28 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 07:56:28 [DEBUG   ] Finished updating board flags in 1.434 seconds
2014-02-27 07:56:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 07:56:49 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 07:57:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-27 07:57:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 07:57:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 07:57:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 07:57:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 07:57:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 07:57:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 07:57:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 07:57:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 07:57:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 07:57:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 07:57:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 07:57:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 07:57:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 07:57:28 [DEBUG   ] Finished updating board flags in 1.403 seconds
2014-02-27 07:57:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 07:57:35 [DEBUG   ] Got command RPT from MCS: ref #289617
2014-02-27 07:57:35 [DEBUG   ] summary = ERROR
2014-02-27 07:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289617  13 56715 28655717 A  ERRORERROR'
2014-02-27 07:57:35 [DEBUG   ] Got command RPT from MCS: ref #289618
2014-02-27 07:57:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 07:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289618  77 56715 28655718 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 07:57:50 [DEBUG   ] Finished updating ant stats in 1.598 seconds
2014-02-27 07:58:10 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-02-27 07:58:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 07:58:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 07:58:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 07:58:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 07:58:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 07:58:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 07:58:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 07:58:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 07:58:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 07:58:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 07:58:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 07:58:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 07:58:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 07:58:28 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 07:58:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 07:58:28 [DEBUG   ] Finished updating board flags in 1.348 seconds
2014-02-27 07:58:30 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-27 07:58:50 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 07:59:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 07:59:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 07:59:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 07:59:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 07:59:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 07:59:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 07:59:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 07:59:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 07:59:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 07:59:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 07:59:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 07:59:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 07:59:28 [DEBUG   ] Finished updating board flags in 1.372 seconds
2014-02-27 07:59:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 07:59:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 08:00:10 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 08:00:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:00:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:00:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:00:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:00:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:00:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 08:00:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 08:00:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:00:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:00:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:00:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:00:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:00:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 08:00:29 [DEBUG   ] Finished updating board flags in 2.100 seconds
2014-02-27 08:00:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 08:00:50 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-27 08:01:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 08:01:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:01:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:01:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:01:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:01:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:01:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-02-27 08:01:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 08:01:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 08:01:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:01:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:01:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:01:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:01:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:01:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 08:01:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 08:01:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 08:01:29 [DEBUG   ] Finished updating board flags in 2.082 seconds
2014-02-27 08:01:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 08:01:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 08:02:10 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-27 08:02:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:02:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:02:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:02:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:02:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:02:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 08:02:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 08:02:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 08:02:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 08:02:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:02:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:02:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:02:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:02:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:02:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 08:02:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 08:02:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 08:02:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2014-02-27 08:02:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 08:02:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 08:02:29 [DEBUG   ] Finished updating board flags in 1.917 seconds
2014-02-27 08:02:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 08:02:35 [DEBUG   ] Got command RPT from MCS: ref #289634
2014-02-27 08:02:35 [DEBUG   ] summary = ERROR
2014-02-27 08:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289634  13 56715 28955717 A  ERRORERROR'
2014-02-27 08:02:35 [DEBUG   ] Got command RPT from MCS: ref #289635
2014-02-27 08:02:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 08:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289635  77 56715 28955718 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 08:02:50 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 08:03:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 08:03:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:03:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:03:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:03:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:03:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:03:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-02-27 08:03:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 08:03:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:03:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:03:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:03:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:03:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:03:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 08:03:29 [DEBUG   ] Finished updating board flags in 1.791 seconds
2014-02-27 08:03:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 08:03:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 08:04:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 08:04:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:04:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:04:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:04:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:04:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:04:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:04:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:04:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:04:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:04:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:04:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 08:04:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 08:04:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 08:04:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 08:04:29 [DEBUG   ] Finished updating board flags in 1.600 seconds
2014-02-27 08:04:30 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-27 08:04:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 08:05:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 08:05:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:05:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:05:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:05:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:05:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:05:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 08:05:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 08:05:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:05:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:05:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:05:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:05:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:05:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 08:05:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 08:05:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 08:05:29 [DEBUG   ] Finished updating board flags in 1.610 seconds
2014-02-27 08:05:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 08:05:50 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-02-27 08:06:10 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-27 08:06:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:06:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:06:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:06:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:06:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:06:29 [DEBUG   ] Finished updating board flags in 1.574 seconds
2014-02-27 08:06:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 08:06:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 08:07:10 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-02-27 08:07:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:07:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:07:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:07:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:07:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:07:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 08:07:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:07:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:07:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:07:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:07:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:07:29 [DEBUG   ] Finished updating board flags in 1.417 seconds
2014-02-27 08:07:30 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2014-02-27 08:07:35 [DEBUG   ] Got command RPT from MCS: ref #289651
2014-02-27 08:07:35 [DEBUG   ] summary = ERROR
2014-02-27 08:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289651  13 56715 29255714 A  ERRORERROR'
2014-02-27 08:07:35 [DEBUG   ] Got command RPT from MCS: ref #289652
2014-02-27 08:07:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 08:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289652  77 56715 29255714 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 08:07:51 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-02-27 08:08:11 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-27 08:08:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:08:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:08:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:08:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:08:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:08:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-02-27 08:08:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:08:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:08:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:08:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:08:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:08:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 08:08:29 [DEBUG   ] Finished updating board flags in 1.381 seconds
2014-02-27 08:08:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-27 08:08:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 08:09:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 08:09:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:09:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:09:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:09:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:09:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:09:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-27 08:09:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:09:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:09:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:09:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:09:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:09:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 08:09:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 08:09:30 [DEBUG   ] Finished updating board flags in 2.269 seconds
2014-02-27 08:09:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 08:09:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 08:10:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 08:10:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:10:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:10:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:10:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:10:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:10:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2014-02-27 08:10:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 08:10:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 08:10:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:10:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:10:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:10:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:10:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:10:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 08:10:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 08:10:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 08:10:30 [DEBUG   ] Finished updating board flags in 2.166 seconds
2014-02-27 08:10:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 08:10:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 08:11:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 08:11:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:11:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:11:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:11:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:11:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:11:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 08:11:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 08:11:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:11:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:11:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:11:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:11:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:11:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 08:11:30 [DEBUG   ] Finished updating board flags in 2.061 seconds
2014-02-27 08:11:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 08:11:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 08:12:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 08:12:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:12:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:12:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:12:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:12:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:12:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 08:12:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 08:12:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:12:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:12:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:12:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:12:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:12:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 08:12:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 08:12:30 [DEBUG   ] Finished updating board flags in 2.029 seconds
2014-02-27 08:12:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-27 08:12:35 [DEBUG   ] Got command RPT from MCS: ref #289668
2014-02-27 08:12:35 [DEBUG   ] summary = ERROR
2014-02-27 08:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289668  13 56715 29555722 A  ERRORERROR'
2014-02-27 08:12:35 [DEBUG   ] Got command RPT from MCS: ref #289669
2014-02-27 08:12:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 08:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289669  77 56715 29555722 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 08:12:51 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-02-27 08:13:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 08:13:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:13:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:13:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:13:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:13:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:13:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:13:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:13:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:13:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:13:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:13:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 08:13:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 08:13:30 [DEBUG   ] Finished updating board flags in 1.903 seconds
2014-02-27 08:13:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 08:13:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 08:14:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 08:14:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:14:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:14:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:14:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:14:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:14:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 08:14:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 08:14:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:14:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:14:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:14:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:14:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:14:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 08:14:30 [DEBUG   ] Finished updating board flags in 1.819 seconds
2014-02-27 08:14:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 08:14:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 08:15:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 08:15:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:15:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:15:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:15:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:15:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:15:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 08:15:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:15:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:15:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:15:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:15:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:15:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 08:15:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 08:15:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 08:15:30 [DEBUG   ] Finished updating board flags in 1.795 seconds
2014-02-27 08:15:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 08:15:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 08:16:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 08:16:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:16:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:16:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:16:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:16:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:16:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 08:16:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:16:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:16:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:16:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:16:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:16:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 08:16:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 08:16:30 [DEBUG   ] Finished updating board flags in 1.647 seconds
2014-02-27 08:16:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 08:16:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 08:17:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 08:17:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:17:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:17:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:17:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:17:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:17:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 08:17:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 08:17:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:17:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:17:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:17:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:17:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:17:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 08:17:30 [DEBUG   ] Finished updating board flags in 1.577 seconds
2014-02-27 08:17:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 08:17:35 [DEBUG   ] Got command RPT from MCS: ref #289685
2014-02-27 08:17:35 [DEBUG   ] summary = ERROR
2014-02-27 08:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289685  13 56715 29855718 A  ERRORERROR'
2014-02-27 08:17:35 [DEBUG   ] Got command RPT from MCS: ref #289686
2014-02-27 08:17:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 08:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289686  77 56715 29855718 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 08:17:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 08:18:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 08:18:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:18:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:18:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:18:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:18:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:18:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 08:18:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 08:18:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 08:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:18:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 08:18:30 [DEBUG   ] Finished updating board flags in 1.577 seconds
2014-02-27 08:18:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 08:18:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 08:19:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 08:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:19:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 08:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:19:31 [DEBUG   ] Finished updating ant stats in 1.048 seconds
2014-02-27 08:19:31 [DEBUG   ] Finished updating board flags in 2.282 seconds
2014-02-27 08:19:51 [DEBUG   ] Finished updating ant stats in 0.956 seconds
2014-02-27 08:20:11 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 08:20:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:20:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:20:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:20:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:20:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:20:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2014-02-27 08:20:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2014-02-27 08:20:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 08:20:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:20:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:20:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:20:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:20:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:20:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 08:20:31 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2014-02-27 08:20:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 08:20:31 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 08:20:31 [DEBUG   ] Finished updating board flags in 2.143 seconds
2014-02-27 08:20:51 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2014-02-27 08:21:12 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-02-27 08:21:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:21:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:21:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:21:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:21:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:21:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-02-27 08:21:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 08:21:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:21:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:21:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:21:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:21:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:21:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 08:21:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 08:21:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 08:21:31 [DEBUG   ] Finished updating board flags in 2.030 seconds
2014-02-27 08:21:32 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-27 08:21:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 08:22:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 08:22:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:22:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:22:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:22:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:22:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:22:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2014-02-27 08:22:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 08:22:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 08:22:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:22:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:22:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:22:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:22:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:22:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 08:22:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-02-27 08:22:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 08:22:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 08:22:31 [DEBUG   ] Finished updating board flags in 1.951 seconds
2014-02-27 08:22:32 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 08:22:35 [DEBUG   ] Got command RPT from MCS: ref #289702
2014-02-27 08:22:35 [DEBUG   ] summary = ERROR
2014-02-27 08:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289702  13 56715 30155721 A  ERRORERROR'
2014-02-27 08:22:35 [DEBUG   ] Got command RPT from MCS: ref #289703
2014-02-27 08:22:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 08:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289703  77 56715 30155722 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 08:22:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 08:23:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 08:23:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:23:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:23:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:23:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:23:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:23:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 08:23:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 08:23:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 08:23:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:23:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:23:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:23:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:23:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:23:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 08:23:31 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 08:23:31 [DEBUG   ] Finished updating board flags in 1.834 seconds
2014-02-27 08:23:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 08:23:52 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 08:24:12 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2014-02-27 08:24:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:24:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:24:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:24:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:24:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:24:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 08:24:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 08:24:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:24:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:24:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:24:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:24:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:24:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 08:24:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 08:24:31 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 08:24:31 [DEBUG   ] Finished updating board flags in 1.755 seconds
2014-02-27 08:24:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 08:24:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 08:25:12 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 08:25:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:25:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:25:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:25:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:25:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:25:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 08:25:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2014-02-27 08:25:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-27 08:25:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:25:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:25:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:25:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:25:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:25:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 08:25:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 08:25:31 [DEBUG   ] Finished updating board flags in 1.604 seconds
2014-02-27 08:25:32 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 08:25:53 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-02-27 08:26:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-27 08:26:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:26:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:26:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:26:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:26:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:26:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 08:26:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 08:26:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 08:26:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:26:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:26:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:26:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:26:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:26:31 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 08:26:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 08:26:31 [DEBUG   ] Finished updating board flags in 1.609 seconds
2014-02-27 08:26:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 08:26:53 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2014-02-27 08:27:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 08:27:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:27:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:27:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:27:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:27:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:27:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:27:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:27:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:27:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:27:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:27:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 08:27:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 08:27:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2014-02-27 08:27:31 [DEBUG   ] Finished updating board flags in 1.585 seconds
2014-02-27 08:27:33 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-27 08:27:35 [DEBUG   ] Got command RPT from MCS: ref #289719
2014-02-27 08:27:35 [DEBUG   ] summary = ERROR
2014-02-27 08:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289719  13 56715 30455721 A  ERRORERROR'
2014-02-27 08:27:35 [DEBUG   ] Got command RPT from MCS: ref #289720
2014-02-27 08:27:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 08:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289720  77 56715 30455722 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 08:27:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 08:28:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 08:28:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:28:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:28:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:28:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:28:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:28:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 08:28:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:28:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:28:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:28:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:28:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:28:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 08:28:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2014-02-27 08:28:31 [DEBUG   ] Finished updating board flags in 1.409 seconds
2014-02-27 08:28:33 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 08:28:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 08:29:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 08:29:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:29:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:29:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:29:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:29:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:29:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 08:29:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:29:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:29:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:29:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:29:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:29:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 08:29:31 [DEBUG   ] Finished updating board flags in 1.386 seconds
2014-02-27 08:29:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 08:29:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 08:30:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 08:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:30:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 08:30:32 [DEBUG   ] Finished updating board flags in 2.237 seconds
2014-02-27 08:30:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 08:30:53 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 08:31:14 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-02-27 08:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:31:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 08:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:31:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 08:31:32 [DEBUG   ] Finished updating board flags in 2.164 seconds
2014-02-27 08:31:34 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-27 08:31:54 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 08:32:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 08:32:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:32:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:32:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:32:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:32:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:32:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2014-02-27 08:32:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-02-27 08:32:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 08:32:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:32:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:32:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:32:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:32:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:32:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 08:32:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 08:32:32 [DEBUG   ] Finished updating board flags in 2.026 seconds
2014-02-27 08:32:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 08:32:35 [DEBUG   ] Got command RPT from MCS: ref #289736
2014-02-27 08:32:35 [DEBUG   ] summary = ERROR
2014-02-27 08:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289736  13 56715 30755729 A  ERRORERROR'
2014-02-27 08:32:35 [DEBUG   ] Got command RPT from MCS: ref #289737
2014-02-27 08:32:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 08:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289737  77 56715 30755730 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 08:32:54 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-02-27 08:33:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 08:33:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:33:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:33:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:33:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:33:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:33:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 08:33:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 08:33:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 08:33:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2014-02-27 08:33:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:33:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:33:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:33:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:33:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:33:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 08:33:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-02-27 08:33:32 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 08:33:32 [DEBUG   ] Finished updating board flags in 1.980 seconds
2014-02-27 08:33:34 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 08:33:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 08:34:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 08:34:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:34:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:34:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:34:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:34:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:34:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 08:34:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 08:34:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 08:34:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:34:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:34:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:34:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:34:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:34:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 08:34:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 08:34:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 08:34:32 [DEBUG   ] Finished updating board flags in 1.817 seconds
2014-02-27 08:34:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 08:34:54 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 08:35:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 08:35:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:35:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:35:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:35:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:35:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:35:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 08:35:31 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 08:35:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 08:35:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:35:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:35:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:35:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:35:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:35:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 08:35:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 08:35:32 [DEBUG   ] Finished updating board flags in 1.788 seconds
2014-02-27 08:35:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 08:35:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 08:36:14 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 08:36:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:36:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:36:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:36:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:36:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:36:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 08:36:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 08:36:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:36:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:36:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:36:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:36:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:36:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 08:36:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 08:36:32 [DEBUG   ] Finished updating board flags in 1.622 seconds
2014-02-27 08:36:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 08:36:55 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-27 08:37:15 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-02-27 08:37:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:37:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:37:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:37:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:37:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:37:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 08:37:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:37:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:37:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:37:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:37:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:37:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 08:37:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2014-02-27 08:37:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 08:37:32 [DEBUG   ] Finished updating board flags in 1.578 seconds
2014-02-27 08:37:35 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-27 08:37:35 [DEBUG   ] Got command RPT from MCS: ref #289753
2014-02-27 08:37:35 [DEBUG   ] summary = ERROR
2014-02-27 08:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289753  13 56715 31055725 A  ERRORERROR'
2014-02-27 08:37:35 [DEBUG   ] Got command RPT from MCS: ref #289754
2014-02-27 08:37:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 08:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289754  77 56715 31055726 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 08:37:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 08:38:15 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 08:38:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:38:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:38:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:38:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:38:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:38:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 08:38:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 08:38:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:38:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:38:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:38:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:38:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:38:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 08:38:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 08:38:32 [DEBUG   ] Finished updating board flags in 1.419 seconds
2014-02-27 08:38:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 08:38:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 08:39:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 08:39:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:39:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:39:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:39:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:39:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:39:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 08:39:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 08:39:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:39:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:39:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:39:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:39:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:39:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 08:39:32 [DEBUG   ] Finished updating board flags in 1.484 seconds
2014-02-27 08:39:35 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 08:39:55 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 08:40:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 08:40:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:40:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:40:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:40:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:40:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:40:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 08:40:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-27 08:40:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 08:40:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:40:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:40:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:40:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:40:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:40:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 08:40:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 08:40:32 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 08:40:32 [DEBUG   ] Finished updating board flags in 1.483 seconds
2014-02-27 08:40:35 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 08:40:55 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 08:41:15 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 08:41:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:41:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:41:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:41:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:41:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:41:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 08:41:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 08:41:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:41:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:41:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:41:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:41:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:41:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 08:41:32 [DEBUG   ] Finished updating board flags in 1.519 seconds
2014-02-27 08:41:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 08:41:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 08:42:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 08:42:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:42:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:42:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:42:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:42:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:42:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2014-02-27 08:42:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:42:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:42:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:42:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:42:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:42:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-02-27 08:42:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 08:42:33 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 08:42:33 [DEBUG   ] Finished updating board flags in 2.197 seconds
2014-02-27 08:42:35 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 08:42:35 [DEBUG   ] Got command RPT from MCS: ref #289770
2014-02-27 08:42:35 [DEBUG   ] summary = ERROR
2014-02-27 08:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289770  13 56715 31355725 A  ERRORERROR'
2014-02-27 08:42:35 [DEBUG   ] Got command RPT from MCS: ref #289771
2014-02-27 08:42:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 08:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289771  77 56715 31355726 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 08:42:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 08:43:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 08:43:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:43:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:43:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:43:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:43:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:43:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 08:43:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:43:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:43:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:43:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:43:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:43:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 08:43:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 08:43:33 [DEBUG   ] Finished updating board flags in 1.899 seconds
2014-02-27 08:43:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 08:43:55 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 08:44:16 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-02-27 08:44:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:44:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:44:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:44:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:44:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:44:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-02-27 08:44:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 08:44:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 08:44:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:44:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:44:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:44:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:44:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:44:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 08:44:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 08:44:33 [DEBUG   ] Finished updating board flags in 1.831 seconds
2014-02-27 08:44:36 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-27 08:44:56 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 08:45:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 08:45:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:45:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:45:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:45:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:45:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:45:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 08:45:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2014-02-27 08:45:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:45:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:45:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:45:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:45:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:45:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-02-27 08:45:33 [DEBUG   ] Finished updating board flags in 1.780 seconds
2014-02-27 08:45:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 08:45:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 08:46:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 08:46:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:46:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:46:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:46:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:46:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:46:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 08:46:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:46:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:46:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:46:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:46:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:46:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 08:46:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 08:46:33 [DEBUG   ] Finished updating board flags in 1.631 seconds
2014-02-27 08:46:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 08:46:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 08:47:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 08:47:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:47:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:47:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:47:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:47:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:47:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:47:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:47:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:47:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:47:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:47:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 08:47:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 08:47:33 [DEBUG   ] Finished updating board flags in 1.584 seconds
2014-02-27 08:47:35 [DEBUG   ] Got command RPT from MCS: ref #289787
2014-02-27 08:47:35 [DEBUG   ] summary = ERROR
2014-02-27 08:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289787  13 56715 31655730 A  ERRORERROR'
2014-02-27 08:47:35 [DEBUG   ] Got command RPT from MCS: ref #289788
2014-02-27 08:47:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 08:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289788  77 56715 31655730 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 08:47:36 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 08:47:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 08:48:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 08:48:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:48:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:48:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:48:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:48:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:48:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 08:48:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 08:48:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 08:48:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:48:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:48:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:48:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:48:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:48:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 08:48:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 08:48:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 08:48:33 [DEBUG   ] Finished updating board flags in 1.404 seconds
2014-02-27 08:48:36 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 08:48:56 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 08:49:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 08:49:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:49:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:49:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:49:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:49:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:49:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 08:49:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:49:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:49:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:49:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:49:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:49:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 08:49:33 [DEBUG   ] Finished updating board flags in 1.393 seconds
2014-02-27 08:49:37 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-02-27 08:49:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 08:50:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 08:50:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:50:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:50:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:50:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:50:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:50:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 08:50:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-27 08:50:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:50:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:50:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:50:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:50:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:50:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 08:50:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 08:50:33 [DEBUG   ] Finished updating board flags in 1.362 seconds
2014-02-27 08:50:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 08:50:57 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 08:51:17 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-27 08:51:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:51:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:51:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:51:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:51:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:51:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 08:51:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2014-02-27 08:51:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 08:51:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:51:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:51:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:51:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:51:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:51:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 08:51:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 08:51:34 [DEBUG   ] Finished updating board flags in 2.059 seconds
2014-02-27 08:51:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 08:51:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 08:52:17 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 08:52:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:52:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:52:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:52:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:52:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:52:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 08:52:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 08:52:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:52:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:52:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:52:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:52:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:52:34 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 08:52:34 [DEBUG   ] Finished updating board flags in 1.990 seconds
2014-02-27 08:52:35 [DEBUG   ] Got command RPT from MCS: ref #289804
2014-02-27 08:52:35 [DEBUG   ] summary = ERROR
2014-02-27 08:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289804  13 56715 31955733 A  ERRORERROR'
2014-02-27 08:52:35 [DEBUG   ] Got command RPT from MCS: ref #289805
2014-02-27 08:52:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 08:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289805  77 56715 31955734 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 08:52:37 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-02-27 08:52:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 08:53:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 08:53:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:53:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:53:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:53:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:53:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:53:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 08:53:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 08:53:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 08:53:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 08:53:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:53:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:53:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:53:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:53:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:53:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 08:53:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 08:53:34 [DEBUG   ] Finished updating board flags in 1.812 seconds
2014-02-27 08:53:37 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 08:53:58 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-02-27 08:54:18 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2014-02-27 08:54:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:54:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:54:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:54:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:54:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:54:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 08:54:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-27 08:54:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 08:54:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:54:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:54:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:54:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:54:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:54:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 08:54:34 [DEBUG   ] Finished updating board flags in 1.788 seconds
2014-02-27 08:54:38 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 08:54:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 08:55:18 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 08:55:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:55:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:55:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:55:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:55:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:55:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2014-02-27 08:55:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:55:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:55:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:55:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:55:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:55:34 [DEBUG   ] Finished updating board flags in 1.624 seconds
2014-02-27 08:55:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 08:55:58 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 08:56:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 08:56:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:56:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:56:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:56:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:56:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:56:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 08:56:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:56:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:56:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:56:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:56:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:56:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 08:56:34 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 08:56:34 [DEBUG   ] Finished updating board flags in 1.580 seconds
2014-02-27 08:56:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 08:56:58 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-27 08:57:18 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 08:57:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:57:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:57:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:57:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:57:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:57:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 08:57:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 08:57:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 08:57:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:57:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:57:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:57:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:57:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:57:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 08:57:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 5
2014-02-27 08:57:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 08:57:34 [DEBUG   ] Finished updating board flags in 1.504 seconds
2014-02-27 08:57:35 [DEBUG   ] Got command RPT from MCS: ref #289821
2014-02-27 08:57:35 [DEBUG   ] summary = ERROR
2014-02-27 08:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289821  13 56715 32255725 A  ERRORERROR'
2014-02-27 08:57:35 [DEBUG   ] Got command RPT from MCS: ref #289822
2014-02-27 08:57:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 08:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289822  77 56715 32255726 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 08:57:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 08:57:59 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-27 08:58:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 08:58:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:58:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:58:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:58:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:58:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:58:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 08:58:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:58:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:58:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:58:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:58:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:58:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 08:58:34 [DEBUG   ] Finished updating board flags in 1.369 seconds
2014-02-27 08:58:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 08:58:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 08:59:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 08:59:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 08:59:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 08:59:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 08:59:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 08:59:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 08:59:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 08:59:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 08:59:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 08:59:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 08:59:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 08:59:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 08:59:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 08:59:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-02-27 08:59:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 08:59:35 [DEBUG   ] Finished updating board flags in 2.150 seconds
2014-02-27 08:59:39 [DEBUG   ] Finished updating ant stats in 1.192 seconds
2014-02-27 08:59:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 09:00:19 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-27 09:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:00:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 09:00:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:00:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:00:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:00:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:00:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:00:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-02-27 09:00:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 09:00:35 [DEBUG   ] Finished updating board flags in 1.987 seconds
2014-02-27 09:00:39 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-27 09:00:59 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 09:01:19 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-02-27 09:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:01:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 09:01:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-27 09:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:01:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-02-27 09:01:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 09:01:35 [DEBUG   ] Finished updating board flags in 1.817 seconds
2014-02-27 09:01:40 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-02-27 09:02:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 09:02:20 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-02-27 09:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:02:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 09:02:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2014-02-27 09:02:35 [DEBUG   ] Finished updating board flags in 1.787 seconds
2014-02-27 09:02:35 [DEBUG   ] Got command RPT from MCS: ref #289838
2014-02-27 09:02:35 [DEBUG   ] summary = ERROR
2014-02-27 09:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289838  13 56715 32555737 A  ERRORERROR'
2014-02-27 09:02:35 [DEBUG   ] Got command RPT from MCS: ref #289839
2014-02-27 09:02:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 09:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289839  77 56715 32555738 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 09:02:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 09:03:00 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-27 09:03:20 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 09:03:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:03:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:03:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:03:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:03:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:03:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 09:03:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:03:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:03:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:03:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:03:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:03:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 09:03:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 09:03:35 [DEBUG   ] Finished updating board flags in 1.605 seconds
2014-02-27 09:03:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 09:04:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 09:04:20 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-27 09:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:04:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 09:04:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 09:04:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 09:04:35 [DEBUG   ] Finished updating board flags in 1.607 seconds
2014-02-27 09:04:40 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 09:05:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 09:05:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 09:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:05:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 09:05:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-27 09:05:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 09:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:05:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 09:05:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 09:05:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 09:05:35 [DEBUG   ] Finished updating board flags in 1.592 seconds
2014-02-27 09:05:40 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 09:06:00 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2014-02-27 09:06:21 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-27 09:06:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:06:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:06:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:06:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:06:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:06:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 09:06:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 09:06:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:06:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:06:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:06:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:06:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:06:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2014-02-27 09:06:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 09:06:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 09:06:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 09:06:35 [DEBUG   ] Finished updating board flags in 1.418 seconds
2014-02-27 09:06:40 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-27 09:07:01 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-02-27 09:07:21 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-27 09:07:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:07:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:07:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:07:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:07:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:07:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 09:07:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 09:07:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:07:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:07:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:07:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:07:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:07:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 09:07:35 [DEBUG   ] Finished updating board flags in 1.392 seconds
2014-02-27 09:07:35 [DEBUG   ] Got command RPT from MCS: ref #289855
2014-02-27 09:07:35 [DEBUG   ] summary = ERROR
2014-02-27 09:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289855  13 56715 32855733 A  ERRORERROR'
2014-02-27 09:07:35 [DEBUG   ] Got command RPT from MCS: ref #289856
2014-02-27 09:07:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 09:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289856  77 56715 32855734 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 09:07:41 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 09:08:01 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-27 09:08:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-02-27 09:08:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:08:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:08:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:08:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:08:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:08:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 09:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:08:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 09:08:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 09:08:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 09:08:36 [DEBUG   ] Finished updating board flags in 2.211 seconds
2014-02-27 09:08:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 09:09:01 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2014-02-27 09:09:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 09:09:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:09:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:09:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:09:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:09:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:09:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 09:09:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 09:09:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 09:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:09:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 09:09:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 09:09:36 [DEBUG   ] Finished updating board flags in 2.181 seconds
2014-02-27 09:09:41 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2014-02-27 09:10:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 09:10:21 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 09:10:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:10:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:10:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:10:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:10:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:10:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:10:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:10:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:10:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:10:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:10:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2014-02-27 09:10:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 09:10:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 09:10:36 [DEBUG   ] Finished updating board flags in 2.019 seconds
2014-02-27 09:10:41 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 09:11:01 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 09:11:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 09:11:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:11:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:11:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:11:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:11:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:11:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 09:11:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:11:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:11:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:11:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:11:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:11:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 09:11:36 [DEBUG   ] Finished updating board flags in 1.980 seconds
2014-02-27 09:11:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 09:12:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 09:12:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 09:12:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:12:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:12:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:12:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:12:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:12:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 09:12:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 09:12:35 [DEBUG   ] Got command RPT from MCS: ref #289872
2014-02-27 09:12:35 [DEBUG   ] summary = ERROR
2014-02-27 09:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289872  13 56715 33155730 A  ERRORERROR'
2014-02-27 09:12:35 [DEBUG   ] Got command RPT from MCS: ref #289873
2014-02-27 09:12:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 09:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289873  77 56715 33155730 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 09:12:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:12:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:12:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:12:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:12:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:12:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 09:12:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 09:12:36 [DEBUG   ] Finished updating board flags in 1.898 seconds
2014-02-27 09:12:41 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-27 09:13:01 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2014-02-27 09:13:22 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-02-27 09:13:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:13:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:13:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:13:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:13:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:13:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:13:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:13:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:13:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:13:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:13:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 09:13:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 09:13:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 09:13:36 [DEBUG   ] Finished updating board flags in 1.732 seconds
2014-02-27 09:13:42 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-27 09:14:02 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-27 09:14:22 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 09:14:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:14:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:14:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:14:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:14:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:14:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:14:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:14:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:14:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:14:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:14:36 [DEBUG   ] Finished updating board flags in 1.587 seconds
2014-02-27 09:14:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 09:15:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 09:15:22 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-27 09:15:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:15:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:15:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:15:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:15:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:15:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 09:15:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 09:15:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 09:15:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 09:15:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:15:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:15:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:15:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:15:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:15:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 09:15:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 09:15:36 [DEBUG   ] Finished updating board flags in 1.394 seconds
2014-02-27 09:15:42 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 09:16:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 09:16:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 09:16:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:16:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:16:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:16:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:16:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:16:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 09:16:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 09:16:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:16:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:16:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:16:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:16:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:16:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-02-27 09:16:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 09:16:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 09:16:36 [DEBUG   ] Finished updating board flags in 1.365 seconds
2014-02-27 09:16:42 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-27 09:17:02 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 09:17:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 09:17:35 [DEBUG   ] Got command RPT from MCS: ref #289889
2014-02-27 09:17:35 [DEBUG   ] summary = ERROR
2014-02-27 09:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289889  13 56715 33455742 A  ERRORERROR'
2014-02-27 09:17:35 [DEBUG   ] Got command RPT from MCS: ref #289890
2014-02-27 09:17:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 09:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289890  77 56715 33455742 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 09:17:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:17:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:17:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:17:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:17:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:17:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:17:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:17:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:17:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:17:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:17:37 [DEBUG   ] Finished updating board flags in 2.051 seconds
2014-02-27 09:17:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 09:18:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 09:18:22 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 09:18:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:18:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:18:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:18:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:18:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:18:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 09:18:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 09:18:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:18:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:18:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:18:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:18:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:18:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 09:18:37 [DEBUG   ] Finished updating board flags in 1.991 seconds
2014-02-27 09:18:43 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-02-27 09:19:03 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2014-02-27 09:19:23 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 09:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:19:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 09:19:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 09:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:19:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 09:19:37 [DEBUG   ] Finished updating board flags in 1.821 seconds
2014-02-27 09:19:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 09:20:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 09:20:23 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 09:20:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:20:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:20:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:20:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:20:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:20:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2014-02-27 09:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:20:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 09:20:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 09:20:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 09:20:37 [DEBUG   ] Finished updating board flags in 1.784 seconds
2014-02-27 09:20:43 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 09:21:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 09:21:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 09:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:21:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 09:21:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 09:21:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-27 09:21:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:21:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:21:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:21:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:21:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:21:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 09:21:37 [DEBUG   ] Finished updating board flags in 1.614 seconds
2014-02-27 09:21:43 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-27 09:22:03 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2014-02-27 09:22:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 09:22:35 [DEBUG   ] Got command RPT from MCS: ref #289906
2014-02-27 09:22:35 [DEBUG   ] summary = ERROR
2014-02-27 09:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289906  13 56715 33755733 A  ERRORERROR'
2014-02-27 09:22:35 [DEBUG   ] Got command RPT from MCS: ref #289907
2014-02-27 09:22:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 09:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289907  77 56715 33755734 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 09:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:22:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 09:22:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:22:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:22:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:22:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:22:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:22:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 09:22:37 [DEBUG   ] Finished updating board flags in 1.587 seconds
2014-02-27 09:22:43 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2014-02-27 09:23:04 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-02-27 09:23:24 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-27 09:23:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:23:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:23:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:23:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:23:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:23:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 09:23:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:23:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:23:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:23:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:23:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:23:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2014-02-27 09:23:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 09:23:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 09:23:37 [DEBUG   ] Finished updating board flags in 1.411 seconds
2014-02-27 09:23:44 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 09:24:04 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 09:24:24 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 09:24:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:24:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:24:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:24:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:24:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:24:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 09:24:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:24:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:24:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:24:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:24:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:24:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 09:24:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 09:24:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 09:24:37 [DEBUG   ] Finished updating board flags in 1.404 seconds
2014-02-27 09:24:44 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-27 09:25:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 09:25:24 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 09:25:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:25:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:25:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:25:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:25:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:25:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 09:25:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 09:25:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 09:25:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:25:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:25:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:25:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:25:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:25:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-02-27 09:25:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 09:25:37 [DEBUG   ] Finished updating board flags in 1.395 seconds
2014-02-27 09:25:44 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 09:26:05 [DEBUG   ] Finished updating ant stats in 1.602 seconds
2014-02-27 09:26:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 09:26:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:26:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:26:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:26:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:26:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:26:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 09:26:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 09:26:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:26:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:26:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:26:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:26:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:26:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-02-27 09:26:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 09:26:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 09:26:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2014-02-27 09:26:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 09:26:37 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 09:26:37 [DEBUG   ] Finished updating board flags in 1.362 seconds
2014-02-27 09:26:44 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-27 09:27:04 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 09:27:25 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-27 09:27:35 [DEBUG   ] Got command RPT from MCS: ref #289923
2014-02-27 09:27:35 [DEBUG   ] summary = ERROR
2014-02-27 09:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289923  13 56715 34055741 A  ERRORERROR'
2014-02-27 09:27:35 [DEBUG   ] Got command RPT from MCS: ref #289924
2014-02-27 09:27:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 09:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289924  77 56715 34055742 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 09:27:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:27:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:27:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:27:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:27:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:27:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 09:27:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 09:27:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:27:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:27:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:27:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:27:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:27:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 09:27:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-02-27 09:27:38 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 09:27:38 [DEBUG   ] Finished updating board flags in 2.057 seconds
2014-02-27 09:27:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 09:28:05 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-02-27 09:28:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 09:28:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:28:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:28:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:28:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:28:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:28:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 09:28:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:28:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:28:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:28:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:28:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:28:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 09:28:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 09:28:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 1
2014-02-27 09:28:38 [DEBUG   ] Finished updating board flags in 1.983 seconds
2014-02-27 09:28:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 09:29:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 09:29:25 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-27 09:29:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:29:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:29:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:29:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:29:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:29:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 09:29:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 09:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:29:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 09:29:38 [DEBUG   ] Finished updating board flags in 1.828 seconds
2014-02-27 09:29:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 09:30:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 09:30:25 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2014-02-27 09:30:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:30:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:30:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:30:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:30:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:30:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 09:30:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-27 09:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:30:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-02-27 09:30:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 09:30:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 09:30:38 [DEBUG   ] Finished updating board flags in 1.782 seconds
2014-02-27 09:30:45 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-02-27 09:31:05 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-27 09:31:26 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-27 09:31:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:31:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:31:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:31:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:31:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:31:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 09:31:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:31:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:31:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:31:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:31:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:31:38 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 09:31:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 09:31:38 [DEBUG   ] Finished updating board flags in 1.604 seconds
2014-02-27 09:31:46 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-27 09:32:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 09:32:26 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-27 09:32:35 [DEBUG   ] Got command RPT from MCS: ref #289940
2014-02-27 09:32:35 [DEBUG   ] summary = ERROR
2014-02-27 09:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289940  13 56715 34355741 A  ERRORERROR'
2014-02-27 09:32:35 [DEBUG   ] Got command RPT from MCS: ref #289941
2014-02-27 09:32:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 09:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289941  77 56715 34355742 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 09:32:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:32:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:32:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:32:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:32:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:32:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:32:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:32:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:32:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:32:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:32:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 09:32:38 [DEBUG   ] Finished updating board flags in 1.597 seconds
2014-02-27 09:32:46 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 09:33:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 09:33:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 09:33:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:33:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:33:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:33:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:33:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:33:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 09:33:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 09:33:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:33:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:33:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:33:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:33:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:33:38 [DEBUG   ] Finished updating board flags in 1.419 seconds
2014-02-27 09:33:46 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 09:34:06 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 09:34:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 09:34:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:34:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:34:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:34:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:34:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:34:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:34:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:34:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:34:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:34:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:34:38 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 09:34:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 09:34:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 09:34:38 [DEBUG   ] Finished updating board flags in 1.409 seconds
2014-02-27 09:34:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 09:35:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 09:35:26 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 09:35:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:35:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:35:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:35:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:35:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:35:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 09:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:35:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 09:35:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 09:35:38 [DEBUG   ] Finished updating board flags in 1.428 seconds
2014-02-27 09:35:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 09:36:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 09:36:26 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-27 09:36:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:36:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:36:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:36:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:36:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:36:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 09:36:38 [DEBUG   ] Finished updating board flags in 1.413 seconds
2014-02-27 09:36:46 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2014-02-27 09:37:06 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 09:37:26 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 09:37:35 [DEBUG   ] Got command RPT from MCS: ref #289957
2014-02-27 09:37:35 [DEBUG   ] summary = ERROR
2014-02-27 09:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289957  13 56715 34655737 A  ERRORERROR'
2014-02-27 09:37:35 [DEBUG   ] Got command RPT from MCS: ref #289958
2014-02-27 09:37:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 09:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289958  77 56715 34655738 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 09:37:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:37:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:37:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:37:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:37:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:37:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:37:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:37:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:37:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:37:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:37:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 09:37:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-02-27 09:37:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 09:37:38 [DEBUG   ] Finished updating board flags in 1.420 seconds
2014-02-27 09:37:47 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-02-27 09:38:07 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-27 09:38:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 09:38:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:38:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:38:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:38:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:38:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:38:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 09:38:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 09:38:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:38:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:38:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:38:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:38:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:38:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 09:38:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 09:38:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 09:38:38 [DEBUG   ] Finished updating board flags in 1.432 seconds
2014-02-27 09:38:47 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 09:39:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 09:39:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 09:39:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:39:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:39:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:39:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:39:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:39:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:39:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:39:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:39:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:39:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:39:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 09:39:38 [DEBUG   ] Finished updating board flags in 1.422 seconds
2014-02-27 09:39:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 09:40:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 09:40:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 09:40:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:40:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:40:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:40:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:40:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:40:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 09:40:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:40:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:40:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:40:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:40:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:40:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 09:40:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 09:40:38 [DEBUG   ] Finished updating board flags in 1.433 seconds
2014-02-27 09:40:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 09:41:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 09:41:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 09:41:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:41:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:41:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:41:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:41:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:41:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 09:41:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2014-02-27 09:41:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:41:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:41:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:41:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:41:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:41:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 09:41:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 09:41:38 [DEBUG   ] Finished updating board flags in 1.427 seconds
2014-02-27 09:41:47 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 09:42:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 09:42:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 09:42:35 [DEBUG   ] Got command RPT from MCS: ref #289974
2014-02-27 09:42:35 [DEBUG   ] summary = ERROR
2014-02-27 09:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289974  13 56715 34955741 A  ERRORERROR'
2014-02-27 09:42:35 [DEBUG   ] Got command RPT from MCS: ref #289975
2014-02-27 09:42:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 09:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289975  77 56715 34955742 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 09:42:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:42:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:42:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:42:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:42:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:42:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 09:42:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 09:42:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-27 09:42:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:42:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:42:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:42:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:42:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:42:38 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 09:42:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 09:42:38 [DEBUG   ] Finished updating board flags in 1.441 seconds
2014-02-27 09:42:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 09:43:07 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 09:43:27 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 09:43:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:43:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:43:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:43:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:43:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:43:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 09:43:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:43:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:43:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:43:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:43:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:43:39 [DEBUG   ] Finished updating board flags in 2.221 seconds
2014-02-27 09:43:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 09:44:08 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-02-27 09:44:28 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-27 09:44:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:44:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:44:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:44:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:44:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:44:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 09:44:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:44:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:44:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:44:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:44:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:44:39 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 09:44:39 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 09:44:39 [DEBUG   ] Finished updating board flags in 2.218 seconds
2014-02-27 09:44:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 09:45:08 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-27 09:45:28 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 09:45:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:45:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:45:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:45:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:45:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:45:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 09:45:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 09:45:38 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 09:45:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:45:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:45:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:45:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:45:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:45:39 [DEBUG   ] Finished updating board flags in 2.144 seconds
2014-02-27 09:45:48 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-27 09:46:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 09:46:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 09:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:46:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 09:46:39 [DEBUG   ] Finished updating board flags in 2.021 seconds
2014-02-27 09:46:48 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 09:47:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 09:47:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 09:47:35 [DEBUG   ] Got command RPT from MCS: ref #289991
2014-02-27 09:47:35 [DEBUG   ] summary = ERROR
2014-02-27 09:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289991  13 56715 35255741 A  ERRORERROR'
2014-02-27 09:47:35 [DEBUG   ] Got command RPT from MCS: ref #289992
2014-02-27 09:47:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 09:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   289992  77 56715 35255742 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 09:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:47:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2014-02-27 09:47:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 09:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:47:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 09:47:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 09:47:39 [DEBUG   ] Finished updating board flags in 1.983 seconds
2014-02-27 09:47:48 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-27 09:48:08 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 09:48:29 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-02-27 09:48:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:48:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:48:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:48:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:48:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:48:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-02-27 09:48:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 09:48:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:48:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:48:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:48:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:48:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:48:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 09:48:39 [DEBUG   ] Finished updating board flags in 1.817 seconds
2014-02-27 09:48:49 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-27 09:49:09 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2014-02-27 09:49:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 09:49:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:49:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:49:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:49:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:49:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:49:38 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 09:49:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 09:49:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:49:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:49:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:49:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:49:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:49:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-02-27 09:49:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 09:49:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 09:49:39 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 09:49:39 [DEBUG   ] Finished updating board flags in 1.802 seconds
2014-02-27 09:49:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 09:50:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 09:50:29 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2014-02-27 09:50:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:50:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:50:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:50:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:50:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:50:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 09:50:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:50:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:50:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:50:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:50:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:50:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 09:50:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 09:50:39 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 09:50:39 [DEBUG   ] Finished updating board flags in 1.794 seconds
2014-02-27 09:50:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 09:51:09 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2014-02-27 09:51:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 09:51:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:51:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:51:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:51:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:51:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:51:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-02-27 09:51:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-02-27 09:51:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:51:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:51:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:51:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:51:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:51:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 09:51:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 09:51:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-02-27 09:51:39 [DEBUG   ] Finished updating board flags in 1.603 seconds
2014-02-27 09:51:49 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-02-27 09:52:09 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-27 09:52:30 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-02-27 09:52:35 [DEBUG   ] Got command RPT from MCS: ref #290008
2014-02-27 09:52:35 [DEBUG   ] summary = ERROR
2014-02-27 09:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290008  13 56715 35555745 A  ERRORERROR'
2014-02-27 09:52:35 [DEBUG   ] Got command RPT from MCS: ref #290009
2014-02-27 09:52:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 09:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290009  77 56715 35555746 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 09:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:52:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 09:52:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 09:52:39 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 09:52:39 [DEBUG   ] Finished updating board flags in 1.600 seconds
2014-02-27 09:52:50 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-27 09:53:10 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-02-27 09:53:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 09:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:53:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 09:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:53:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 09:53:39 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 09:53:39 [DEBUG   ] Finished updating board flags in 1.415 seconds
2014-02-27 09:53:50 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 09:54:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 09:54:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 09:54:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:54:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:54:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:54:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:54:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:54:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-27 09:54:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 09:54:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:54:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:54:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:54:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:54:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:54:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 09:54:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 09:54:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-02-27 09:54:39 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 09:54:39 [DEBUG   ] Finished updating board flags in 1.389 seconds
2014-02-27 09:54:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 09:55:10 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 09:55:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 09:55:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:55:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:55:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:55:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:55:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:55:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 09:55:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:55:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:55:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:55:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:55:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:55:39 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 09:55:39 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 09:55:39 [DEBUG   ] Finished updating board flags in 1.353 seconds
2014-02-27 09:55:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 09:56:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 09:56:30 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 09:56:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:56:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:56:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:56:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:56:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:56:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:56:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:56:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:56:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:56:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:56:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 09:56:40 [DEBUG   ] Finished updating board flags in 2.098 seconds
2014-02-27 09:56:51 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-02-27 09:57:11 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-27 09:57:31 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-02-27 09:57:35 [DEBUG   ] Got command RPT from MCS: ref #290025
2014-02-27 09:57:35 [DEBUG   ] summary = ERROR
2014-02-27 09:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290025  13 56715 35855745 A  ERRORERROR'
2014-02-27 09:57:35 [DEBUG   ] Got command RPT from MCS: ref #290026
2014-02-27 09:57:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 09:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290026  77 56715 35855746 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 09:57:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:57:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:57:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:57:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:57:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:57:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 09:57:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 09:57:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2014-02-27 09:57:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:57:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:57:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:57:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:57:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:57:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 09:57:40 [DEBUG   ] Finished updating board flags in 1.965 seconds
2014-02-27 09:57:51 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-27 09:58:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 09:58:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 09:58:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:58:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:58:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:58:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:58:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:58:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 09:58:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 09:58:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:58:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:58:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:58:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:58:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:58:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 09:58:40 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 09:58:40 [DEBUG   ] Finished updating board flags in 1.803 seconds
2014-02-27 09:58:51 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2014-02-27 09:59:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 09:59:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 09:59:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 09:59:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 09:59:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 09:59:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 09:59:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 09:59:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 09:59:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 09:59:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 09:59:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 09:59:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 09:59:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 09:59:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 09:59:40 [DEBUG   ] Finished updating board flags in 1.791 seconds
2014-02-27 09:59:51 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 10:00:12 [DEBUG   ] Finished updating ant stats in 1.390 seconds
2014-02-27 10:00:32 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-27 10:00:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:00:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:00:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:00:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:00:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:00:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 10:00:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 10:00:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:00:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:00:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:00:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:00:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:00:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 10:00:40 [DEBUG   ] Finished updating board flags in 1.612 seconds
2014-02-27 10:00:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 10:01:12 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 10:01:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 10:01:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:01:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:01:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:01:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:01:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:01:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 10:01:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 10:01:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:01:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:01:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:01:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:01:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:01:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 10:01:40 [DEBUG   ] Finished updating board flags in 1.594 seconds
2014-02-27 10:01:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 10:02:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 10:02:32 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 10:02:35 [DEBUG   ] Got command RPT from MCS: ref #290042
2014-02-27 10:02:35 [DEBUG   ] summary = ERROR
2014-02-27 10:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290042  13 56715 36155749 A  ERRORERROR'
2014-02-27 10:02:35 [DEBUG   ] Got command RPT from MCS: ref #290043
2014-02-27 10:02:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 10:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290043  77 56715 36155750 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 10:02:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:02:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:02:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:02:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:02:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:02:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:02:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:02:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:02:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:02:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:02:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 10:02:40 [DEBUG   ] Finished updating board flags in 1.420 seconds
2014-02-27 10:02:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 10:03:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 10:03:32 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-27 10:03:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:03:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:03:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:03:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:03:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:03:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:03:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:03:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:03:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:03:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:03:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 10:03:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 10:03:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 10:03:40 [DEBUG   ] Finished updating board flags in 1.387 seconds
2014-02-27 10:03:52 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 10:04:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 10:04:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 10:04:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:04:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:04:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:04:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:04:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:04:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:04:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:04:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:04:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:04:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:04:40 [DEBUG   ] Finished updating board flags in 1.354 seconds
2014-02-27 10:04:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 10:05:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 10:05:33 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-02-27 10:05:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:05:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:05:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:05:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:05:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:05:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 10:05:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 10:05:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:05:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:05:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:05:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:05:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:05:41 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 10:05:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 10:05:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 10:05:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 10:05:41 [DEBUG   ] Finished updating board flags in 2.068 seconds
2014-02-27 10:05:53 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-27 10:06:13 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2014-02-27 10:06:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 10:06:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:06:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:06:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:06:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:06:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:06:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 10:06:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2014-02-27 10:06:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:06:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:06:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:06:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:06:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:06:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 10:06:41 [DEBUG   ] Finished updating board flags in 1.980 seconds
2014-02-27 10:06:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 10:07:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 10:07:33 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-27 10:07:35 [DEBUG   ] Got command RPT from MCS: ref #290059
2014-02-27 10:07:35 [DEBUG   ] summary = ERROR
2014-02-27 10:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290059  13 56715 36455741 A  ERRORERROR'
2014-02-27 10:07:35 [DEBUG   ] Got command RPT from MCS: ref #290060
2014-02-27 10:07:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 10:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290060  77 56715 36455742 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 10:07:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:07:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:07:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:07:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:07:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:07:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 10:07:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-02-27 10:07:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 10:07:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 10:07:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:07:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:07:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:07:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:07:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:07:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-02-27 10:07:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 10:07:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2014-02-27 10:07:41 [DEBUG   ] Finished updating board flags in 1.822 seconds
2014-02-27 10:07:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 10:08:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 10:08:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 10:08:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:08:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:08:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:08:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:08:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:08:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 10:08:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:08:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:08:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:08:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:08:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:08:41 [DEBUG   ] Finished updating board flags in 1.779 seconds
2014-02-27 10:08:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 10:09:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 10:09:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 10:09:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:09:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:09:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:09:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:09:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:09:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 10:09:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:09:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:09:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:09:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:09:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:09:41 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 10:09:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 10:09:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 10:09:41 [DEBUG   ] Finished updating board flags in 1.663 seconds
2014-02-27 10:09:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 10:10:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 10:10:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 10:10:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:10:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:10:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:10:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:10:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:10:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 10:10:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:10:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:10:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:10:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:10:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:10:41 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 10:10:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 10:10:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 10:10:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 10:10:41 [DEBUG   ] Finished updating board flags in 1.563 seconds
2014-02-27 10:10:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 10:11:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 10:11:33 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 10:11:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:11:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:11:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:11:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:11:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:11:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-02-27 10:11:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 10:11:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:11:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:11:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:11:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:11:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:11:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2014-02-27 10:11:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 10:11:41 [DEBUG   ] Finished updating board flags in 1.487 seconds
2014-02-27 10:11:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 10:12:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 10:12:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 10:12:35 [DEBUG   ] Got command RPT from MCS: ref #290076
2014-02-27 10:12:35 [DEBUG   ] summary = ERROR
2014-02-27 10:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290076  13 56715 36755745 A  ERRORERROR'
2014-02-27 10:12:35 [DEBUG   ] Got command RPT from MCS: ref #290077
2014-02-27 10:12:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 10:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290077  77 56715 36755746 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 10:12:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:12:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:12:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:12:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:12:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:12:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-02-27 10:12:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:12:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:12:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:12:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:12:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:12:41 [DEBUG   ] Finished updating board flags in 1.486 seconds
2014-02-27 10:12:53 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-02-27 10:13:14 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-02-27 10:13:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 10:13:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:13:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:13:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:13:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:13:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:13:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 10:13:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:13:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:13:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:13:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:13:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:13:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 10:13:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-02-27 10:13:41 [DEBUG   ] Finished updating board flags in 1.490 seconds
2014-02-27 10:13:54 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2014-02-27 10:14:14 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 10:14:34 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 10:14:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:14:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:14:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:14:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:14:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:14:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 10:14:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 10:14:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:14:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:14:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:14:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:14:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:14:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 10:14:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 10:14:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 10:14:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 10:14:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 10:14:42 [DEBUG   ] Finished updating board flags in 2.194 seconds
2014-02-27 10:14:54 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 10:15:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 10:15:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 10:15:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:15:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:15:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:15:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:15:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:15:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:15:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:15:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:15:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:15:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:15:42 [DEBUG   ] Finished updating board flags in 1.958 seconds
2014-02-27 10:15:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 10:16:14 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 10:16:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 10:16:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:16:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:16:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:16:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:16:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:16:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 10:16:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 10:16:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 10:16:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:16:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:16:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:16:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:16:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:16:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-02-27 10:16:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 10:16:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 10:16:42 [DEBUG   ] Finished updating board flags in 1.792 seconds
2014-02-27 10:16:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 10:17:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 10:17:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 10:17:35 [DEBUG   ] Got command RPT from MCS: ref #290093
2014-02-27 10:17:35 [DEBUG   ] summary = ERROR
2014-02-27 10:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290093  13 56715 37055753 A  ERRORERROR'
2014-02-27 10:17:35 [DEBUG   ] Got command RPT from MCS: ref #290094
2014-02-27 10:17:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 10:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290094  77 56715 37055754 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 10:17:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:17:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:17:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:17:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:17:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:17:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 10:17:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 10:17:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:17:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:17:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:17:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:17:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:17:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 10:17:42 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 10:17:42 [DEBUG   ] Finished updating board flags in 1.632 seconds
2014-02-27 10:17:54 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-02-27 10:18:15 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-27 10:18:34 [DEBUG   ] Finished updating ant stats in 0.408 seconds
2014-02-27 10:18:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:18:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:18:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:18:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:18:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:18:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 10:18:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 10:18:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:18:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:18:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:18:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:18:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:18:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 10:18:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 10:18:42 [DEBUG   ] Finished updating board flags in 1.606 seconds
2014-02-27 10:18:55 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-02-27 10:19:15 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-27 10:19:35 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 10:19:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:19:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:19:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:19:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:19:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:19:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:19:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:19:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:19:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:19:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:19:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-02-27 10:19:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 10:19:42 [DEBUG   ] Finished updating board flags in 1.557 seconds
2014-02-27 10:19:55 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-02-27 10:20:15 [DEBUG   ] Finished updating ant stats in 0.987 seconds
2014-02-27 10:20:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 10:20:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:20:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:20:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:20:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:20:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:20:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 10:20:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 10:20:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 10:20:42 [DEBUG   ] Finished updating board flags in 1.421 seconds
2014-02-27 10:20:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 10:21:15 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2014-02-27 10:21:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 10:21:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:21:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:21:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:21:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:21:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:21:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:21:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 10:21:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 10:21:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 10:21:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 10:21:42 [DEBUG   ] Finished updating board flags in 1.386 seconds
2014-02-27 10:21:55 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 10:22:16 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-02-27 10:22:35 [DEBUG   ] Got command RPT from MCS: ref #290110
2014-02-27 10:22:35 [DEBUG   ] summary = ERROR
2014-02-27 10:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290110  13 56715 37355746 A  ERRORERROR'
2014-02-27 10:22:35 [DEBUG   ] Got command RPT from MCS: ref #290111
2014-02-27 10:22:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 10:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290111  77 56715 37355746 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 10:22:36 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-27 10:22:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:22:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:22:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:22:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:22:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:22:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 10:22:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:22:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:22:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:22:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:22:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:22:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 10:22:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 10:22:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 10:22:42 [DEBUG   ] Finished updating board flags in 1.363 seconds
2014-02-27 10:22:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 10:23:16 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 10:23:36 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 10:23:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:23:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:23:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:23:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:23:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:23:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 10:23:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 10:23:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 10:23:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:23:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:23:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:23:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:23:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:23:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 10:23:43 [DEBUG   ] Finished updating board flags in 2.054 seconds
2014-02-27 10:23:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 10:24:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 10:24:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 10:24:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:24:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:24:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:24:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:24:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:24:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 10:24:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:24:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:24:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:24:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:24:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:24:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-02-27 10:24:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 10:24:43 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 10:24:43 [DEBUG   ] Finished updating board flags in 1.987 seconds
2014-02-27 10:24:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 10:25:16 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-27 10:25:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 10:25:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:25:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:25:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:25:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:25:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:25:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 10:25:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 10:25:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:25:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:25:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:25:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:25:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:25:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 10:25:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 10:25:43 [DEBUG   ] Finished updating board flags in 1.813 seconds
2014-02-27 10:25:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 10:26:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 10:26:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 10:26:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:26:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:26:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:26:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:26:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:26:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:26:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:26:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:26:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:26:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:26:43 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 10:26:43 [DEBUG   ] Finished updating board flags in 1.794 seconds
2014-02-27 10:26:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 10:27:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 10:27:35 [DEBUG   ] Got command RPT from MCS: ref #290127
2014-02-27 10:27:35 [DEBUG   ] summary = ERROR
2014-02-27 10:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290127  13 56715 37655758 A  ERRORERROR'
2014-02-27 10:27:35 [DEBUG   ] Got command RPT from MCS: ref #290128
2014-02-27 10:27:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 10:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290128  77 56715 37655758 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 10:27:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 10:27:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:27:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:27:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:27:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:27:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:27:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 10:27:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 10:27:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:27:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 10:27:43 [DEBUG   ] Finished updating board flags in 1.609 seconds
2014-02-27 10:27:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 10:28:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 10:28:36 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 10:28:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:28:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:28:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:28:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:28:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:28:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 10:28:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:28:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 10:28:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 10:28:43 [DEBUG   ] Finished updating board flags in 1.588 seconds
2014-02-27 10:28:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 10:29:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 10:29:36 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-02-27 10:29:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:29:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:29:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:29:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:29:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:29:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 10:29:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 10:29:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 10:29:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2014-02-27 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:29:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2014-02-27 10:29:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 10:29:43 [DEBUG   ] Finished updating board flags in 1.420 seconds
2014-02-27 10:29:56 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-02-27 10:30:17 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-02-27 10:30:37 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-27 10:30:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:30:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:30:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:30:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:30:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:30:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 10:30:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 10:30:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 10:30:43 [DEBUG   ] Finished updating board flags in 1.391 seconds
2014-02-27 10:30:57 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 10:31:17 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2014-02-27 10:31:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 10:31:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:31:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:31:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:31:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:31:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:31:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 10:31:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 10:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:31:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 10:31:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 10:31:43 [DEBUG   ] Finished updating board flags in 1.387 seconds
2014-02-27 10:31:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 10:32:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 10:32:35 [DEBUG   ] Got command RPT from MCS: ref #290144
2014-02-27 10:32:35 [DEBUG   ] summary = ERROR
2014-02-27 10:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290144  13 56715 37955749 A  ERRORERROR'
2014-02-27 10:32:35 [DEBUG   ] Got command RPT from MCS: ref #290145
2014-02-27 10:32:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 10:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290145  77 56715 37955750 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 10:32:37 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 10:32:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:32:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:32:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:32:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:32:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:32:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2014-02-27 10:32:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 10:32:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 10:32:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:32:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:32:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:32:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:32:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:32:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 10:32:44 [DEBUG   ] Finished updating board flags in 2.132 seconds
2014-02-27 10:32:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 10:33:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 10:33:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 10:33:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:33:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:33:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:33:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:33:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:33:43 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 10:33:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:33:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:33:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:33:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:33:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:33:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-02-27 10:33:44 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 10:33:44 [DEBUG   ] Finished updating board flags in 1.905 seconds
2014-02-27 10:33:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 10:34:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 10:34:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 10:34:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:34:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:34:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:34:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:34:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:34:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:34:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:34:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:34:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:34:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:34:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 10:34:44 [DEBUG   ] Finished updating board flags in 1.812 seconds
2014-02-27 10:34:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 10:35:17 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2014-02-27 10:35:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 10:35:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:35:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:35:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:35:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:35:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:35:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 10:35:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:35:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:35:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:35:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:35:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:35:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 10:35:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 10:35:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 10:35:44 [DEBUG   ] Finished updating board flags in 1.776 seconds
2014-02-27 10:35:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 10:36:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 10:36:37 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 10:36:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:36:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:36:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:36:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:36:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:36:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 10:36:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:36:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:36:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:36:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:36:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:36:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 10:36:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-02-27 10:36:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 10:36:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-02-27 10:36:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 10:36:44 [DEBUG   ] Finished updating board flags in 1.611 seconds
2014-02-27 10:36:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 10:37:17 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 10:37:35 [DEBUG   ] Got command RPT from MCS: ref #290161
2014-02-27 10:37:35 [DEBUG   ] summary = ERROR
2014-02-27 10:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290161  13 56715 38255757 A  ERRORERROR'
2014-02-27 10:37:35 [DEBUG   ] Got command RPT from MCS: ref #290162
2014-02-27 10:37:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 10:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290162  77 56715 38255758 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 10:37:37 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-02-27 10:37:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:37:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:37:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:37:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:37:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:37:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 10:37:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:37:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:37:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:37:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:37:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:37:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-02-27 10:37:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 10:37:44 [DEBUG   ] Finished updating board flags in 1.589 seconds
2014-02-27 10:37:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 10:38:18 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-27 10:38:37 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-02-27 10:38:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:38:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:38:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:38:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:38:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:38:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 10:38:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-02-27 10:38:43 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 10:38:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:38:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:38:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:38:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:38:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:38:44 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 10:38:44 [DEBUG   ] Finished updating board flags in 1.414 seconds
2014-02-27 10:38:58 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-02-27 10:39:18 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-27 10:39:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 10:39:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:39:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:39:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:39:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:39:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:39:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 10:39:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:39:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:39:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:39:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:39:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:39:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 10:39:44 [DEBUG   ] Finished updating board flags in 1.644 seconds
2014-02-27 10:39:58 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2014-02-27 10:40:18 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-27 10:40:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 10:40:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:40:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:40:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:40:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:40:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:40:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:40:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:40:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:40:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:40:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:40:44 [DEBUG   ] Finished updating board flags in 1.354 seconds
2014-02-27 10:40:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 10:41:18 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 10:41:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 10:41:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:41:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:41:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:41:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:41:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:41:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:41:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:41:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:41:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:41:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:41:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 10:41:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-02-27 10:41:44 [DEBUG   ] Finished updating board flags in 1.360 seconds
2014-02-27 10:41:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 10:42:18 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 10:42:35 [DEBUG   ] Got command RPT from MCS: ref #290178
2014-02-27 10:42:35 [DEBUG   ] summary = ERROR
2014-02-27 10:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290178  13 56715 38555761 A  ERRORERROR'
2014-02-27 10:42:35 [DEBUG   ] Got command RPT from MCS: ref #290179
2014-02-27 10:42:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 10:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290179  77 56715 38555762 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 10:42:38 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 10:42:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:42:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:42:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:42:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:42:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:42:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 10:42:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-02-27 10:42:45 [DEBUG   ] Finished updating board flags in 2.050 seconds
2014-02-27 10:42:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 10:43:19 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-02-27 10:43:38 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-02-27 10:43:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:43:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:43:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:43:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:43:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:43:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-02-27 10:43:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:43:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:43:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:43:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:43:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:43:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 10:43:45 [DEBUG   ] Finished updating board flags in 1.994 seconds
2014-02-27 10:43:59 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-02-27 10:44:19 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-27 10:44:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 10:44:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:44:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:44:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:44:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:44:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:44:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 10:44:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 10:44:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:44:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:44:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:44:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:44:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:44:45 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 10:44:45 [DEBUG   ] Finished updating board flags in 1.810 seconds
2014-02-27 10:44:59 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2014-02-27 10:45:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 10:45:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 10:45:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:45:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:45:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:45:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:45:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:45:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 10:45:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-02-27 10:45:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:45:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:45:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:45:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:45:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:45:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-02-27 10:45:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 10:45:45 [DEBUG   ] Finished updating board flags in 1.789 seconds
2014-02-27 10:45:59 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 10:46:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 10:46:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-27 10:46:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 10:46:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 10:46:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 10:46:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 10:46:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 10:46:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-02-27 10:46:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-02-27 10:46:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2014-02-27 10:46:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-02-27 10:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 10:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 10:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 10:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 10:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 10:46:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-02-27 10:46:45 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 10:46:45 [DEBUG   ] Finished updating board flags in 1.616 seconds
2014-02-27 10:46:59 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 10:47:00 [DEBUG   ] Got command INI from MCS: ref #290195
2014-02-27 10:47:00 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2014-02-27 10:47:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   290195   8 56715 38820166 ABOOTING'
2014-02-27 10:47:23 [INFO    ] -------------------
2014-02-27 10:47:23 [INFO    ]  LWA board status
2014-02-27 10:47:23 [INFO    ] -------------------
2014-02-27 10:47:23 [INFO    ] DP 1: 2 lwa27
2014-02-27 10:47:23 [INFO    ] DP 1: 3 lwa24
2014-02-27 10:47:23 [INFO    ] DP 1: 4 lwa23
2014-02-27 10:47:23 [INFO    ] DP 1: 5 lwa18
2014-02-27 10:47:23 [INFO    ] DP 1: 6 lwa10
2014-02-27 10:47:23 [INFO    ] DP 1: 7 lwa32
2014-02-27 10:47:23 [INFO    ] DP 1: 8 lwa11
2014-02-27 10:47:23 [INFO    ] DP 1: 9 lwa30
2014-02-27 10:47:23 [INFO    ] DP 1: 10 lwa12
2014-02-27 10:47:23 [INFO    ] DP 1: 11 lwa8
2014-02-27 10:47:23 [INFO    ] DP 1: 12 lwa13
2014-02-27 10:47:23 [INFO    ] DP 1: 13 lwa26
2014-02-27 10:47:23 [INFO    ] DP 1: 14 lwa14
2014-02-27 10:47:23 [INFO    ] DP 1: 16 lwa22
2014-02-27 10:47:23 [INFO    ] DP 1: 17 lwa20
2014-02-27 10:47:23 [INFO    ] DP 1: 18 lwa1
2014-02-27 10:47:23 [INFO    ] DP 1: 19 lwa5
2014-02-27 10:47:23 [INFO    ] DP 1: 20 lwa25
2014-02-27 10:47:23 [INFO    ] DP 1: 21 lwa35
2014-02-27 10:47:23 [INFO    ] DP 1: 22 lwa19
2014-02-27 10:47:23 [INFO    ] DP 1: 23 lwa21
2014-02-27 10:47:23 [INFO    ] DP 1: 24 lwa6
2014-02-27 10:47:23 [INFO    ] DP 1: 25 lwa7
2014-02-27 10:47:23 [INFO    ] DP 1: 26 lwa33
2014-02-27 10:47:23 [INFO    ] DP 1: 27 lwa15
2014-02-27 10:47:23 [INFO    ] DP 1: 28 lwa28
2014-02-27 10:47:23 [INFO    ] DP 2: 1 lwa16
2014-02-27 10:47:23 [INFO    ] DP 2: 15 lwa34
2014-02-27 10:47:23 [INFO    ] Total of 28 boards
2014-02-27 10:47:23 [INFO    ] Total of 260 stands
2014-02-27 10:47:23 [INFO    ] -------------------
2014-02-27 10:47:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2014-02-27 10:47:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2014-02-27 10:47:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2014-02-27 10:47:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2014-02-27 10:47:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2014-02-27 10:47:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2014-02-27 10:47:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2014-02-27 10:47:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2014-02-27 10:47:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2014-02-27 10:47:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2014-02-27 10:47:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2014-02-27 10:47:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2014-02-27 10:47:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2014-02-27 10:47:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2014-02-27 10:47:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2014-02-27 10:47:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2014-02-27 10:47:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2014-02-27 10:47:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2014-02-27 10:47:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2014-02-27 10:47:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2014-02-27 10:47:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2014-02-27 10:47:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2014-02-27 10:47:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2014-02-27 10:47:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2014-02-27 10:47:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2014-02-27 10:47:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2014-02-27 10:47:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2014-02-27 10:47:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2014-02-27 10:47:30 [DEBUG   ] 2014-02-27 10:47:30 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8880
2014-02-27 10:47:30 [DEBUG   ] 2014-02-27 10:47:30 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8881
2014-02-27 10:47:30 [DEBUG   ] 2014-02-27 10:47:30 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8882
2014-02-27 10:47:30 [DEBUG   ] 2014-02-27 10:47:30 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8883
2014-02-27 10:47:30 [DEBUG   ] 2014-02-27 10:47:30 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8884
2014-02-27 10:47:30 [DEBUG   ] 2014-02-27 10:47:30 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8885
2014-02-27 10:47:30 [DEBUG   ] 2014-02-27 10:47:30 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8886
2014-02-27 10:47:30 [DEBUG   ] 2014-02-27 10:47:30 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8887
2014-02-27 10:47:30 [DEBUG   ] 2014-02-27 10:47:30 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8888
2014-02-27 10:47:30 [DEBUG   ] 2014-02-27 10:47:30 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8889
2014-02-27 10:47:30 [DEBUG   ] 2014-02-27 10:47:30 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8890
2014-02-27 10:47:30 [DEBUG   ] 2014-02-27 10:47:30 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8891
2014-02-27 10:47:30 [DEBUG   ] 2014-02-27 10:47:30 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8892
2014-02-27 10:47:30 [DEBUG   ] 2014-02-27 10:47:30 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8893
2014-02-27 10:47:30 [DEBUG   ] 2014-02-27 10:47:30 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8894
2014-02-27 10:47:30 [DEBUG   ] 2014-02-27 10:47:30 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8895
2014-02-27 10:47:30 [DEBUG   ] 2014-02-27 10:47:30 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8896
2014-02-27 10:47:30 [DEBUG   ] 2014-02-27 10:47:30 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8897
2014-02-27 10:47:30 [DEBUG   ] 2014-02-27 10:47:30 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8898
2014-02-27 10:47:30 [DEBUG   ] 2014-02-27 10:47:30 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8899
2014-02-27 10:47:30 [DEBUG   ] 2014-02-27 10:47:30 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8900
2014-02-27 10:47:30 [DEBUG   ] 2014-02-27 10:47:30 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8901
2014-02-27 10:47:30 [DEBUG   ] 2014-02-27 10:47:30 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8902
2014-02-27 10:47:30 [DEBUG   ] 2014-02-27 10:47:30 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8903
2014-02-27 10:47:30 [DEBUG   ] 2014-02-27 10:47:30 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8904
2014-02-27 10:47:30 [DEBUG   ] 2014-02-27 10:47:30 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8905
2014-02-27 10:47:35 [DEBUG   ] Got command RPT from MCS: ref #290196
2014-02-27 10:47:35 [DEBUG   ] summary = BOOTING
2014-02-27 10:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290196  15 56715 38855761 ABOOTINGBOOTING'
2014-02-27 10:47:35 [DEBUG   ] Got command RPT from MCS: ref #290197
2014-02-27 10:47:35 [DEBUG   ] info = Running INI sequence
2014-02-27 10:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290197  28 56715 38855762 ABOOTINGRunning INI sequence'
2014-02-27 10:47:43 [DEBUG   ] 2014-02-27 10:47:43 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8880 exited with status 0
2014-02-27 10:47:43 [DEBUG   ] 2014-02-27 10:47:43 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8881 exited with status 0
2014-02-27 10:47:43 [DEBUG   ] 2014-02-27 10:47:43 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8882 exited with status 0
2014-02-27 10:47:43 [DEBUG   ] 2014-02-27 10:47:43 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8883 exited with status 0
2014-02-27 10:47:43 [DEBUG   ] 2014-02-27 10:47:43 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8884 exited with status 0
2014-02-27 10:47:43 [DEBUG   ] 2014-02-27 10:47:43 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8885 exited with status 0
2014-02-27 10:47:43 [DEBUG   ] 2014-02-27 10:47:43 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8886 exited with status 0
2014-02-27 10:47:43 [DEBUG   ] 2014-02-27 10:47:43 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8887 exited with status 0
2014-02-27 10:47:43 [DEBUG   ] 2014-02-27 10:47:43 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8888 exited with status 0
2014-02-27 10:47:43 [DEBUG   ] 2014-02-27 10:47:43 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8889 exited with status 0
2014-02-27 10:47:43 [DEBUG   ] 2014-02-27 10:47:43 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8890 exited with status 0
2014-02-27 10:47:43 [DEBUG   ] 2014-02-27 10:47:43 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8891 exited with status 0
2014-02-27 10:47:43 [DEBUG   ] 2014-02-27 10:47:43 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8892 exited with status 0
2014-02-27 10:47:43 [DEBUG   ] 2014-02-27 10:47:43 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8893 exited with status 0
2014-02-27 10:47:43 [DEBUG   ] 2014-02-27 10:47:43 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8894 exited with status 0
2014-02-27 10:47:43 [DEBUG   ] 2014-02-27 10:47:43 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8895 exited with status 0
2014-02-27 10:47:43 [DEBUG   ] 2014-02-27 10:47:43 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8896 exited with status 0
2014-02-27 10:47:43 [DEBUG   ] 2014-02-27 10:47:43 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8897 exited with status 0
2014-02-27 10:47:43 [DEBUG   ] 2014-02-27 10:47:43 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8898 exited with status 0
2014-02-27 10:47:43 [DEBUG   ] 2014-02-27 10:47:43 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8899 exited with status 0
2014-02-27 10:47:43 [DEBUG   ] 2014-02-27 10:47:43 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8900 exited with status 0
2014-02-27 10:47:43 [DEBUG   ] 2014-02-27 10:47:43 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8901 exited with status 0
2014-02-27 10:47:43 [DEBUG   ] 2014-02-27 10:47:43 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8902 exited with status 0
2014-02-27 10:47:43 [DEBUG   ] 2014-02-27 10:47:43 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8903 exited with status 0
2014-02-27 10:47:43 [DEBUG   ] 2014-02-27 10:47:43 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8904 exited with status 0
2014-02-27 10:47:43 [DEBUG   ] 2014-02-27 10:47:43 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8905 exited with status 0
2014-02-27 10:47:43 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2014-02-27 10:47:43 [DEBUG   ] spawn_process: at 2014-02-27 10:47:43 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2014-02-27 10:47:43 [DEBUG   ] spawn_process: at 2014-02-27 10:47:43 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2014-02-27 10:47:43 [DEBUG   ] spawn_process: at 2014-02-27 10:47:43 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2014-02-27 10:47:43 [DEBUG   ] spawn_process: at 2014-02-27 10:47:43 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2014-02-27 10:47:43 [DEBUG   ] spawn_process: at 2014-02-27 10:47:43 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2014-02-27 10:47:43 [DEBUG   ] spawn_process: at 2014-02-27 10:47:43 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2014-02-27 10:47:43 [DEBUG   ] spawn_process: at 2014-02-27 10:47:43 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2014-02-27 10:47:43 [DEBUG   ] spawn_process: at 2014-02-27 10:47:43 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2014-02-27 10:47:43 [DEBUG   ] spawn_process: at 2014-02-27 10:47:43 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2014-02-27 10:47:43 [DEBUG   ] spawn_process: at 2014-02-27 10:47:43 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2014-02-27 10:47:43 [DEBUG   ] spawn_process: at 2014-02-27 10:47:43 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2014-02-27 10:47:43 [DEBUG   ] spawn_process: at 2014-02-27 10:47:43 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2014-02-27 10:47:43 [DEBUG   ] spawn_process: at 2014-02-27 10:47:43 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2014-02-27 10:47:43 [DEBUG   ] spawn_process: at 2014-02-27 10:47:43 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2014-02-27 10:47:43 [DEBUG   ] spawn_process: at 2014-02-27 10:47:43 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2014-02-27 10:47:43 [DEBUG   ] spawn_process: at 2014-02-27 10:47:43 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2014-02-27 10:47:43 [DEBUG   ] spawn_process: at 2014-02-27 10:47:43 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2014-02-27 10:47:43 [DEBUG   ] spawn_process: at 2014-02-27 10:47:43 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2014-02-27 10:47:43 [DEBUG   ] spawn_process: at 2014-02-27 10:47:43 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2014-02-27 10:47:43 [DEBUG   ] spawn_process: at 2014-02-27 10:47:43 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2014-02-27 10:47:43 [DEBUG   ] spawn_process: at 2014-02-27 10:47:43 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2014-02-27 10:47:43 [DEBUG   ] spawn_process: at 2014-02-27 10:47:43 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2014-02-27 10:47:43 [DEBUG   ] spawn_process: at 2014-02-27 10:47:43 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2014-02-27 10:47:43 [DEBUG   ] spawn_process: at 2014-02-27 10:47:43 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2014-02-27 10:47:43 [DEBUG   ] spawn_process: at 2014-02-27 10:47:43 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2014-02-27 10:47:43 [DEBUG   ] spawn_process: at 2014-02-27 10:47:43 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2014-02-27 10:47:43 [DEBUG   ] 2014-02-27 10:47:43 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 8932
2014-02-27 10:47:43 [DEBUG   ] 2014-02-27 10:47:43 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 8933
2014-02-27 10:47:48 [DEBUG   ] 2014-02-27 10:47:48 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 8932 exited with status 0
2014-02-27 10:47:48 [DEBUG   ] 2014-02-27 10:47:48 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 8933 exited with status 0
2014-02-27 10:47:48 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2014-02-27 10:47:48 [DEBUG   ] spawn_process: at 2014-02-27 10:47:48 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2014-02-27 10:47:48 [DEBUG   ] spawn_process: at 2014-02-27 10:47:48 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2014-02-27 10:47:48 [INFO    ] Setting Beam 1 xbars
2014-02-27 10:47:48 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2014-02-27 10:47:48 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2014-02-27 10:47:48 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2014-02-27 10:47:49 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2014-02-27 10:47:49 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2014-02-27 10:47:49 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2014-02-27 10:47:49 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2014-02-27 10:47:49 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2014-02-27 10:47:49 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2014-02-27 10:47:49 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2014-02-27 10:47:49 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2014-02-27 10:47:49 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2014-02-27 10:47:50 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2014-02-27 10:47:50 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2014-02-27 10:47:50 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2014-02-27 10:47:50 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2014-02-27 10:47:50 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2014-02-27 10:47:50 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2014-02-27 10:47:50 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2014-02-27 10:47:50 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2014-02-27 10:47:50 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2014-02-27 10:47:51 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2014-02-27 10:47:51 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2014-02-27 10:47:51 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2014-02-27 10:47:51 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2014-02-27 10:47:51 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2014-02-27 10:47:51 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2014-02-27 10:47:51 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2014-02-27 10:47:51 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2014-02-27 10:47:51 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2014-02-27 10:47:52 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2014-02-27 10:47:52 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2014-02-27 10:47:52 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2014-02-27 10:47:52 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2014-02-27 10:47:52 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2014-02-27 10:47:52 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2014-02-27 10:47:52 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2014-02-27 10:47:52 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2014-02-27 10:47:52 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2014-02-27 10:47:52 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2014-02-27 10:47:53 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2014-02-27 10:47:53 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2014-02-27 10:47:53 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2014-02-27 10:47:53 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2014-02-27 10:47:53 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2014-02-27 10:47:53 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2014-02-27 10:47:53 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2014-02-27 10:47:53 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2014-02-27 10:47:53 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2014-02-27 10:47:54 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2014-02-27 10:47:54 [INFO    ] Setting Beam 2 xbars
2014-02-27 10:47:54 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2014-02-27 10:47:54 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2014-02-27 10:47:54 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2014-02-27 10:47:54 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2014-02-27 10:47:54 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2014-02-27 10:47:54 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2014-02-27 10:47:54 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2014-02-27 10:47:54 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2014-02-27 10:47:55 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2014-02-27 10:47:55 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2014-02-27 10:47:55 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2014-02-27 10:47:55 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2014-02-27 10:47:55 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2014-02-27 10:47:55 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2014-02-27 10:47:55 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2014-02-27 10:47:55 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2014-02-27 10:47:55 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2014-02-27 10:47:56 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2014-02-27 10:47:56 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2014-02-27 10:47:56 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2014-02-27 10:47:56 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2014-02-27 10:47:56 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2014-02-27 10:47:56 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2014-02-27 10:47:56 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2014-02-27 10:47:56 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2014-02-27 10:47:56 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2014-02-27 10:47:56 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2014-02-27 10:47:57 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2014-02-27 10:47:57 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2014-02-27 10:47:57 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2014-02-27 10:47:57 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2014-02-27 10:47:57 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2014-02-27 10:47:57 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2014-02-27 10:47:57 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2014-02-27 10:47:57 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2014-02-27 10:47:57 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2014-02-27 10:47:58 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2014-02-27 10:47:58 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2014-02-27 10:47:58 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2014-02-27 10:47:58 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2014-02-27 10:47:58 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2014-02-27 10:47:58 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2014-02-27 10:47:58 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2014-02-27 10:47:58 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2014-02-27 10:47:58 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2014-02-27 10:47:59 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2014-02-27 10:47:59 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2014-02-27 10:47:59 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2014-02-27 10:47:59 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2014-02-27 10:47:59 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2014-02-27 10:47:59 [INFO    ] Setting Beam 3 xbars
2014-02-27 10:47:59 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2014-02-27 10:47:59 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2014-02-27 10:47:59 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2014-02-27 10:47:59 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2014-02-27 10:48:00 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2014-02-27 10:48:00 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2014-02-27 10:48:00 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2014-02-27 10:48:00 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2014-02-27 10:48:00 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2014-02-27 10:48:00 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2014-02-27 10:48:00 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2014-02-27 10:48:00 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2014-02-27 10:48:00 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2014-02-27 10:48:01 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2014-02-27 10:48:01 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2014-02-27 10:48:01 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2014-02-27 10:48:01 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2014-02-27 10:48:01 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2014-02-27 10:48:01 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2014-02-27 10:48:01 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2014-02-27 10:48:01 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2014-02-27 10:48:01 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2014-02-27 10:48:02 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2014-02-27 10:48:02 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2014-02-27 10:48:02 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2014-02-27 10:48:02 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2014-02-27 10:48:02 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2014-02-27 10:48:02 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2014-02-27 10:48:02 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2014-02-27 10:48:02 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2014-02-27 10:48:02 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2014-02-27 10:48:03 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2014-02-27 10:48:03 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2014-02-27 10:48:03 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2014-02-27 10:48:03 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2014-02-27 10:48:03 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2014-02-27 10:48:03 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2014-02-27 10:48:03 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2014-02-27 10:48:03 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2014-02-27 10:48:03 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2014-02-27 10:48:03 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2014-02-27 10:48:04 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2014-02-27 10:48:04 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2014-02-27 10:48:04 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2014-02-27 10:48:04 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2014-02-27 10:48:04 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2014-02-27 10:48:04 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2014-02-27 10:48:04 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2014-02-27 10:48:04 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2014-02-27 10:48:04 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2014-02-27 10:48:05 [INFO    ] Setting Beam 4 xbars
2014-02-27 10:48:05 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2014-02-27 10:48:05 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2014-02-27 10:48:05 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2014-02-27 10:48:05 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2014-02-27 10:48:05 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2014-02-27 10:48:05 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2014-02-27 10:48:05 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2014-02-27 10:48:05 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2014-02-27 10:48:05 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2014-02-27 10:48:06 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2014-02-27 10:48:06 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2014-02-27 10:48:06 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2014-02-27 10:48:06 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2014-02-27 10:48:06 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2014-02-27 10:48:06 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2014-02-27 10:48:06 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2014-02-27 10:48:06 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2014-02-27 10:48:06 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2014-02-27 10:48:07 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2014-02-27 10:48:07 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2014-02-27 10:48:07 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2014-02-27 10:48:07 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2014-02-27 10:48:07 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2014-02-27 10:48:07 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2014-02-27 10:48:07 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2014-02-27 10:48:07 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2014-02-27 10:48:07 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2014-02-27 10:48:08 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2014-02-27 10:48:08 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2014-02-27 10:48:08 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2014-02-27 10:48:08 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2014-02-27 10:48:08 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2014-02-27 10:48:08 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2014-02-27 10:48:08 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2014-02-27 10:48:08 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2014-02-27 10:48:08 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2014-02-27 10:48:09 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2014-02-27 10:48:09 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2014-02-27 10:48:09 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2014-02-27 10:48:09 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2014-02-27 10:48:09 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2014-02-27 10:48:09 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2014-02-27 10:48:09 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2014-02-27 10:48:09 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2014-02-27 10:48:09 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2014-02-27 10:48:09 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2014-02-27 10:48:10 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2014-02-27 10:48:10 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2014-02-27 10:48:10 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2014-02-27 10:48:10 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2014-02-27 10:48:10 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2014-02-27 10:48:10 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2014-02-27 10:48:10 [INFO    ] All xbars set
2014-02-27 10:48:10 [INFO    ] Setting adder chain routing for all beams
2014-02-27 10:48:15 [INFO    ] Setting beam ids
2014-02-27 10:48:25 [INFO    ] Starting beam delay calibration
2014-02-27 10:48:37 [INFO    ] Beam 1 latency is 5738
2014-02-27 10:48:37 [INFO    ] Beam 2 latency is 5764
2014-02-27 10:48:37 [INFO    ] Beam 3 latency is 5753
2014-02-27 10:48:37 [INFO    ] Beam 4 latency is 5743
2014-02-27 10:48:37 [INFO    ] Stop calibration
2014-02-27 10:48:45 [INFO    ] Beam delay calibration successful
2014-02-27 10:48:45 [INFO    ] Calibration passed
2014-02-27 10:48:45 [DEBUG   ] spawn_process: at 2014-02-27 10:48:45 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2014-02-27 10:48:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2014-02-27 10:48:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2014-02-27 10:48:45 [DEBUG   ] spawn_process: at 2014-02-27 10:48:45 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2014-02-27 10:48:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2014-02-27 10:48:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2014-02-27 10:48:45 [DEBUG   ] spawn_process: at 2014-02-27 10:48:45 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2014-02-27 10:48:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2014-02-27 10:48:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2014-02-27 10:48:45 [DEBUG   ] spawn_process: at 2014-02-27 10:48:45 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2014-02-27 10:48:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2014-02-27 10:48:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2014-02-27 10:48:45 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2014-02-27 10:48:46 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 280 ms (1393498126.282 s) with PID 10506 and time 1393498127
2014-02-27 10:48:46 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2014-02-27 10:48:46 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 367 ms (1393498126.369 s) with PID 10509 and time 1393498127
2014-02-27 10:48:47 [DEBUG   ] Finished updating ant stats in 0.879 seconds
2014-02-27 10:48:47 [INFO    ] Started antennas statistics background thread
2014-02-27 10:48:47 [INFO    ] Started board flags background thread
2014-02-27 10:48:47 [INFO    ] Started BAM background thread
2014-02-27 10:48:47 [INFO    ] Finished the INI process (ref. #290195) in 107.328 s
2014-02-27 10:48:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 10:48:48 [DEBUG   ] Finished updating board flags in 1.065 seconds
2014-02-27 10:49:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 10:49:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 10:49:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 10:49:48 [DEBUG   ] Finished updating board flags in 0.988 seconds
2014-02-27 10:50:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 10:50:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 10:50:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 10:50:49 [DEBUG   ] Finished updating board flags in 1.874 seconds
2014-02-27 10:51:07 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-02-27 10:51:27 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 10:51:47 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-27 10:51:48 [DEBUG   ] Finished updating board flags in 1.171 seconds
2014-02-27 10:52:00 [DEBUG   ] Got command RPT from MCS: ref #290213
2014-02-27 10:52:00 [DEBUG   ] summary = NORMAL
2014-02-27 10:52:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290213  14 56715 39120173 A NORMALNORMAL'
2014-02-27 10:52:07 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 10:52:27 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-27 10:52:35 [DEBUG   ] Got command RPT from MCS: ref #290214
2014-02-27 10:52:35 [DEBUG   ] summary = NORMAL
2014-02-27 10:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290214  14 56715 39155753 A NORMALNORMAL'
2014-02-27 10:52:35 [DEBUG   ] Got command RPT from MCS: ref #290215
2014-02-27 10:52:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 10:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290215  48 56715 39155754 A NORMALSystem calibrated and operating normally'
2014-02-27 10:52:47 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-27 10:52:49 [DEBUG   ] Finished updating board flags in 1.571 seconds
2014-02-27 10:53:07 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2014-02-27 10:53:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 10:53:48 [DEBUG   ] Finished updating ant stats in 1.236 seconds
2014-02-27 10:53:49 [DEBUG   ] Finished updating board flags in 1.406 seconds
2014-02-27 10:54:08 [DEBUG   ] Finished updating ant stats in 1.171 seconds
2014-02-27 10:54:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 10:54:48 [DEBUG   ] Finished updating ant stats in 1.031 seconds
2014-02-27 10:54:49 [DEBUG   ] Finished updating board flags in 1.388 seconds
2014-02-27 10:55:08 [DEBUG   ] Finished updating ant stats in 0.975 seconds
2014-02-27 10:55:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 10:55:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 10:55:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-27 10:55:49 [DEBUG   ] Finished updating board flags in 1.207 seconds
2014-02-27 10:56:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 10:56:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 10:56:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 10:56:49 [DEBUG   ] Finished updating board flags in 1.192 seconds
2014-02-27 10:57:08 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 10:57:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 10:57:35 [DEBUG   ] Got command RPT from MCS: ref #290231
2014-02-27 10:57:35 [DEBUG   ] summary = NORMAL
2014-02-27 10:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290231  14 56715 39455757 A NORMALNORMAL'
2014-02-27 10:57:35 [DEBUG   ] Got command RPT from MCS: ref #290232
2014-02-27 10:57:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 10:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290232  48 56715 39455758 A NORMALSystem calibrated and operating normally'
2014-02-27 10:57:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 10:57:49 [DEBUG   ] Finished updating board flags in 1.015 seconds
2014-02-27 10:58:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 10:58:28 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 10:58:48 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-27 10:58:49 [DEBUG   ] Finished updating board flags in 1.010 seconds
2014-02-27 10:59:08 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 10:59:28 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 10:59:48 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-27 10:59:49 [DEBUG   ] Finished updating board flags in 1.005 seconds
2014-02-27 10:59:58 [DEBUG   ] Got command TBN from MCS: ref #290249
2014-02-27 10:59:58 [DEBUG   ] spawn_process: at 2014-02-27 10:59:58 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '1', '1393498799']
2014-02-27 10:59:58 [DEBUG   ] spawn_process: at 2014-02-27 10:59:58 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '2', '1393498799']
2014-02-27 10:59:58 [DEBUG   ] tbn = exited with status True, code 0x00
2014-02-27 10:59:58 [DEBUG   ] spawn_process: at 2014-02-27 10:59:58 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '3', '1393498799']
2014-02-27 10:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   290249   8 56715 39598014 A NORMAL'
2014-02-27 10:59:58 [DEBUG   ] spawn_process: at 2014-02-27 10:59:58 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '4', '1393498799']
2014-02-27 10:59:58 [DEBUG   ] spawn_process: at 2014-02-27 10:59:58 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '5', '1393498799']
2014-02-27 10:59:58 [DEBUG   ] spawn_process: at 2014-02-27 10:59:58 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '6', '1393498799']
2014-02-27 10:59:58 [DEBUG   ] spawn_process: at 2014-02-27 10:59:58 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '7', '1393498799']
2014-02-27 10:59:58 [DEBUG   ] spawn_process: at 2014-02-27 10:59:58 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '8', '1393498799']
2014-02-27 10:59:58 [DEBUG   ] spawn_process: at 2014-02-27 10:59:58 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '9', '1393498799']
2014-02-27 10:59:58 [DEBUG   ] spawn_process: at 2014-02-27 10:59:58 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '10', '1393498799']
2014-02-27 10:59:58 [DEBUG   ] spawn_process: at 2014-02-27 10:59:58 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '11', '1393498799']
2014-02-27 10:59:58 [DEBUG   ] spawn_process: at 2014-02-27 10:59:58 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '12', '1393498799']
2014-02-27 10:59:58 [DEBUG   ] spawn_process: at 2014-02-27 10:59:58 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '13', '1393498799']
2014-02-27 10:59:58 [DEBUG   ] spawn_process: at 2014-02-27 10:59:58 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '14', '1393498799']
2014-02-27 10:59:58 [DEBUG   ] spawn_process: at 2014-02-27 10:59:58 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '15', '1393498799']
2014-02-27 10:59:58 [DEBUG   ] spawn_process: at 2014-02-27 10:59:58 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '16', '1393498799']
2014-02-27 10:59:58 [DEBUG   ] spawn_process: at 2014-02-27 10:59:58 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '17', '1393498799']
2014-02-27 10:59:58 [DEBUG   ] spawn_process: at 2014-02-27 10:59:58 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '18', '1393498799']
2014-02-27 10:59:58 [DEBUG   ] spawn_process: at 2014-02-27 10:59:58 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '19', '1393498799']
2014-02-27 10:59:58 [DEBUG   ] spawn_process: at 2014-02-27 10:59:58 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '20', '1393498799']
2014-02-27 10:59:58 [DEBUG   ] spawn_process: at 2014-02-27 10:59:58 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '21', '1393498799']
2014-02-27 10:59:58 [DEBUG   ] spawn_process: at 2014-02-27 10:59:58 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '22', '1393498799']
2014-02-27 10:59:58 [DEBUG   ] spawn_process: at 2014-02-27 10:59:58 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '23', '1393498799']
2014-02-27 10:59:58 [DEBUG   ] spawn_process: at 2014-02-27 10:59:58 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '24', '1393498799']
2014-02-27 10:59:58 [DEBUG   ] spawn_process: at 2014-02-27 10:59:58 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '25', '1393498799']
2014-02-27 10:59:58 [DEBUG   ] spawn_process: at 2014-02-27 10:59:58 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '26', '1393498799']
2014-02-27 10:59:58 [INFO    ] Finished spawning TBN in 0.049 s
2014-02-27 11:00:08 [DEBUG   ] Finished updating ant stats in 0.466 seconds
2014-02-27 11:00:29 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-02-27 11:00:49 [DEBUG   ] Finished updating ant stats in 1.255 seconds
2014-02-27 11:00:49 [DEBUG   ] Finished updating board flags in 1.493 seconds
2014-02-27 11:01:09 [DEBUG   ] Finished updating ant stats in 1.155 seconds
2014-02-27 11:01:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 11:01:49 [DEBUG   ] Finished updating ant stats in 1.047 seconds
2014-02-27 11:01:50 [DEBUG   ] Finished updating board flags in 2.156 seconds
2014-02-27 11:02:09 [DEBUG   ] Finished updating ant stats in 0.955 seconds
2014-02-27 11:02:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 11:02:35 [DEBUG   ] Got command RPT from MCS: ref #290251
2014-02-27 11:02:35 [DEBUG   ] summary = NORMAL
2014-02-27 11:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290251  14 56715 39755761 A NORMALNORMAL'
2014-02-27 11:02:35 [DEBUG   ] Got command RPT from MCS: ref #290252
2014-02-27 11:02:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 11:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290252  48 56715 39755762 A NORMALSystem calibrated and operating normally'
2014-02-27 11:02:49 [DEBUG   ] Finished updating ant stats in 0.849 seconds
2014-02-27 11:02:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 11:02:50 [DEBUG   ] Finished updating board flags in 1.955 seconds
2014-02-27 11:03:09 [DEBUG   ] Finished updating ant stats in 0.755 seconds
2014-02-27 11:03:30 [DEBUG   ] Finished updating ant stats in 1.599 seconds
2014-02-27 11:03:49 [DEBUG   ] Finished updating ant stats in 0.454 seconds
2014-02-27 11:03:50 [DEBUG   ] Finished updating board flags in 1.816 seconds
2014-02-27 11:04:10 [DEBUG   ] Finished updating ant stats in 1.356 seconds
2014-02-27 11:04:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 11:04:50 [DEBUG   ] Finished updating ant stats in 1.248 seconds
2014-02-27 11:04:50 [DEBUG   ] Finished updating board flags in 1.861 seconds
2014-02-27 11:05:10 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2014-02-27 11:05:30 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 11:05:50 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 11:05:51 [DEBUG   ] Finished updating board flags in 2.171 seconds
2014-02-27 11:06:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 11:06:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 11:06:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 11:06:50 [DEBUG   ] Finished updating ant stats in 0.642 seconds
2014-02-27 11:06:50 [DEBUG   ] Finished updating board flags in 1.624 seconds
2014-02-27 11:07:10 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2014-02-27 11:07:31 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-27 11:07:35 [DEBUG   ] Got command RPT from MCS: ref #290268
2014-02-27 11:07:35 [DEBUG   ] summary = NORMAL
2014-02-27 11:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290268  14 56715 40055765 A NORMALNORMAL'
2014-02-27 11:07:35 [DEBUG   ] Got command RPT from MCS: ref #290269
2014-02-27 11:07:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 11:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290269  48 56715 40055766 A NORMALSystem calibrated and operating normally'
2014-02-27 11:07:50 [DEBUG   ] Finished updating ant stats in 0.448 seconds
2014-02-27 11:07:50 [DEBUG   ] Finished updating board flags in 1.622 seconds
2014-02-27 11:08:11 [DEBUG   ] Finished updating ant stats in 1.355 seconds
2014-02-27 11:08:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 11:08:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-27 11:08:51 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-27 11:08:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 11:08:51 [DEBUG   ] Finished updating board flags in 2.681 seconds
2014-02-27 11:09:11 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-02-27 11:09:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 11:09:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 11:09:50 [DEBUG   ] Finished updating board flags in 1.489 seconds
2014-02-27 11:09:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 11:10:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 11:10:31 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-27 11:10:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 11:10:50 [DEBUG   ] Finished updating board flags in 1.488 seconds
2014-02-27 11:10:51 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-02-27 11:11:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 11:11:31 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 11:11:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-27 11:11:50 [DEBUG   ] Finished updating board flags in 1.478 seconds
2014-02-27 11:11:51 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 11:12:12 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-27 11:12:32 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-27 11:12:35 [DEBUG   ] Got command RPT from MCS: ref #290285
2014-02-27 11:12:35 [DEBUG   ] summary = NORMAL
2014-02-27 11:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290285  14 56715 40355761 A NORMALNORMAL'
2014-02-27 11:12:35 [DEBUG   ] Got command RPT from MCS: ref #290286
2014-02-27 11:12:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 11:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290286  48 56715 40355762 A NORMALSystem calibrated and operating normally'
2014-02-27 11:12:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-27 11:12:50 [DEBUG   ] Finished updating board flags in 1.502 seconds
2014-02-27 11:12:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 11:13:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 11:13:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 11:13:51 [DEBUG   ] Finished updating board flags in 2.179 seconds
2014-02-27 11:13:52 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 11:14:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 11:14:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 11:14:52 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2014-02-27 11:14:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 11:14:52 [DEBUG   ] Finished updating board flags in 2.883 seconds
2014-02-27 11:15:12 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 11:15:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 11:15:51 [DEBUG   ] Finished updating board flags in 1.909 seconds
2014-02-27 11:15:52 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 11:16:12 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 11:16:32 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2014-02-27 11:16:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-27 11:16:51 [DEBUG   ] Finished updating board flags in 1.754 seconds
2014-02-27 11:16:52 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 11:17:12 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 11:17:32 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-02-27 11:17:35 [DEBUG   ] Got command RPT from MCS: ref #290302
2014-02-27 11:17:35 [DEBUG   ] summary = NORMAL
2014-02-27 11:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290302  14 56715 40655769 A NORMALNORMAL'
2014-02-27 11:17:35 [DEBUG   ] Got command RPT from MCS: ref #290303
2014-02-27 11:17:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 11:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290303  48 56715 40655770 A NORMALSystem calibrated and operating normally'
2014-02-27 11:17:51 [DEBUG   ] Finished updating board flags in 1.614 seconds
2014-02-27 11:17:53 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-02-27 11:18:13 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-27 11:18:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 11:18:51 [DEBUG   ] Finished updating board flags in 1.565 seconds
2014-02-27 11:18:53 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 11:19:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 11:19:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 11:19:51 [DEBUG   ] Finished updating board flags in 1.418 seconds
2014-02-27 11:19:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 11:20:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 11:20:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 11:20:51 [DEBUG   ] Finished updating board flags in 1.453 seconds
2014-02-27 11:20:53 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 11:21:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 11:21:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 11:21:51 [DEBUG   ] Finished updating board flags in 1.452 seconds
2014-02-27 11:21:53 [DEBUG   ] Finished updating ant stats in 0.793 seconds
2014-02-27 11:22:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 11:22:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 11:22:35 [DEBUG   ] Got command RPT from MCS: ref #290319
2014-02-27 11:22:35 [DEBUG   ] summary = NORMAL
2014-02-27 11:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290319  14 56715 40955762 A NORMALNORMAL'
2014-02-27 11:22:35 [DEBUG   ] Got command RPT from MCS: ref #290320
2014-02-27 11:22:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 11:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290320  48 56715 40955762 A NORMALSystem calibrated and operating normally'
2014-02-27 11:22:51 [DEBUG   ] Finished updating board flags in 1.446 seconds
2014-02-27 11:22:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 11:23:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 11:23:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 11:23:51 [DEBUG   ] Finished updating board flags in 1.551 seconds
2014-02-27 11:23:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 11:24:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 11:24:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 11:24:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 11:24:52 [DEBUG   ] Finished updating board flags in 2.194 seconds
2014-02-27 11:24:53 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 11:25:14 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-02-27 11:25:34 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-27 11:25:52 [DEBUG   ] Finished updating board flags in 2.004 seconds
2014-02-27 11:25:54 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 11:26:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 11:26:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 11:26:52 [DEBUG   ] Finished updating board flags in 1.900 seconds
2014-02-27 11:26:54 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 11:27:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 11:27:34 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 11:27:35 [DEBUG   ] Got command RPT from MCS: ref #290336
2014-02-27 11:27:35 [DEBUG   ] summary = NORMAL
2014-02-27 11:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290336  14 56715 41255773 A NORMALNORMAL'
2014-02-27 11:27:35 [DEBUG   ] Got command RPT from MCS: ref #290337
2014-02-27 11:27:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 11:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290337  48 56715 41255774 A NORMALSystem calibrated and operating normally'
2014-02-27 11:27:52 [DEBUG   ] Finished updating board flags in 1.815 seconds
2014-02-27 11:27:54 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-02-27 11:28:14 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-27 11:28:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 11:28:52 [DEBUG   ] Finished updating board flags in 1.783 seconds
2014-02-27 11:28:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 11:29:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 11:29:34 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-27 11:29:52 [DEBUG   ] Finished updating board flags in 1.654 seconds
2014-02-27 11:29:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-27 11:30:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 11:30:35 [DEBUG   ] Finished updating ant stats in 1.597 seconds
2014-02-27 11:30:52 [DEBUG   ] Finished updating board flags in 1.554 seconds
2014-02-27 11:30:55 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-02-27 11:31:15 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-27 11:31:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-27 11:31:52 [DEBUG   ] Finished updating board flags in 1.419 seconds
2014-02-27 11:31:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 11:32:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 11:32:35 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 11:32:35 [DEBUG   ] Got command RPT from MCS: ref #290353
2014-02-27 11:32:35 [DEBUG   ] summary = NORMAL
2014-02-27 11:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290353  14 56715 41555773 A NORMALNORMAL'
2014-02-27 11:32:35 [DEBUG   ] Got command RPT from MCS: ref #290354
2014-02-27 11:32:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 11:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290354  48 56715 41555774 A NORMALSystem calibrated and operating normally'
2014-02-27 11:32:52 [DEBUG   ] Finished updating board flags in 1.388 seconds
2014-02-27 11:32:55 [DEBUG   ] Finished updating ant stats in 1.190 seconds
2014-02-27 11:33:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 11:33:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 11:33:52 [DEBUG   ] Finished updating board flags in 1.369 seconds
2014-02-27 11:33:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 11:34:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 11:34:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 11:34:53 [DEBUG   ] Finished updating board flags in 2.072 seconds
2014-02-27 11:34:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 11:35:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 11:35:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 11:35:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-27 11:35:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 11:35:53 [DEBUG   ] Finished updating board flags in 1.995 seconds
2014-02-27 11:35:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 11:36:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 11:36:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 11:36:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-27 11:36:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2014-02-27 11:36:53 [CRITICAL] MGT underflow detected on beam(s) 1
2014-02-27 11:36:53 [DEBUG   ] Finished updating board flags in 1.790 seconds
2014-02-27 11:36:55 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 11:37:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 11:37:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 11:37:35 [DEBUG   ] Got command RPT from MCS: ref #290370
2014-02-27 11:37:35 [DEBUG   ] summary = ERROR
2014-02-27 11:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290370  13 56715 41855769 A  ERRORERROR'
2014-02-27 11:37:35 [DEBUG   ] Got command RPT from MCS: ref #290371
2014-02-27 11:37:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 11:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290371  77 56715 41855770 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 11:37:53 [DEBUG   ] Finished updating board flags in 1.646 seconds
2014-02-27 11:37:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 11:38:15 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2014-02-27 11:38:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 11:38:53 [DEBUG   ] Finished updating board flags in 1.612 seconds
2014-02-27 11:38:55 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 11:39:15 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 11:39:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 11:39:53 [DEBUG   ] Finished updating board flags in 1.530 seconds
2014-02-27 11:39:56 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-02-27 11:40:16 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-27 11:40:36 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 196000019
2014-02-27 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 196000019
2014-02-27 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 196000019
2014-02-27 11:40:53 [DEBUG   ] Finished updating board flags in 1.427 seconds
2014-02-27 11:40:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 11:41:16 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 11:41:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-02-27 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-02-27 11:41:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 11:41:53 [DEBUG   ] Finished updating board flags in 1.395 seconds
2014-02-27 11:41:56 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-27 11:42:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 11:42:35 [DEBUG   ] Got command RPT from MCS: ref #290387
2014-02-27 11:42:35 [DEBUG   ] summary = ERROR
2014-02-27 11:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290387  13 56715 42155778 A  ERRORERROR'
2014-02-27 11:42:35 [DEBUG   ] Got command RPT from MCS: ref #290388
2014-02-27 11:42:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 11:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290388  77 56715 42155778 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 11:42:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 11:42:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 11:42:54 [DEBUG   ] Finished updating board flags in 2.215 seconds
2014-02-27 11:42:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 11:43:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-27 11:43:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 11:43:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 11:43:54 [DEBUG   ] Finished updating board flags in 2.240 seconds
2014-02-27 11:43:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 11:44:16 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 11:44:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 11:44:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 11:44:54 [DEBUG   ] Finished updating board flags in 2.133 seconds
2014-02-27 11:44:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 11:45:16 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 11:45:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 11:45:54 [DEBUG   ] Finished updating board flags in 2.016 seconds
2014-02-27 11:45:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 11:46:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 11:46:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 11:46:54 [DEBUG   ] Finished updating board flags in 2.048 seconds
2014-02-27 11:46:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 11:47:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 11:47:35 [DEBUG   ] Got command RPT from MCS: ref #290404
2014-02-27 11:47:35 [DEBUG   ] summary = ERROR
2014-02-27 11:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290404  13 56715 42455770 A  ERRORERROR'
2014-02-27 11:47:35 [DEBUG   ] Got command RPT from MCS: ref #290405
2014-02-27 11:47:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 11:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290405  77 56715 42455770 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 11:47:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 11:47:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 11:47:54 [DEBUG   ] Finished updating board flags in 2.021 seconds
2014-02-27 11:47:56 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 11:48:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 11:48:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 196000019
2014-02-27 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 196000019
2014-02-27 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 196000019
2014-02-27 11:48:54 [DEBUG   ] Finished updating board flags in 1.936 seconds
2014-02-27 11:48:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 11:49:16 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 11:49:37 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-02-27 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-02-27 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-02-27 11:49:54 [DEBUG   ] Finished updating board flags in 1.812 seconds
2014-02-27 11:49:57 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-02-27 11:50:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 11:50:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2014-02-27 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2014-02-27 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2014-02-27 11:50:54 [DEBUG   ] Finished updating board flags in 1.792 seconds
2014-02-27 11:50:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 11:51:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 11:51:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-02-27 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-02-27 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-02-27 11:51:54 [DEBUG   ] Finished updating board flags in 1.623 seconds
2014-02-27 11:51:57 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 11:52:17 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 11:52:35 [DEBUG   ] Got command RPT from MCS: ref #290421
2014-02-27 11:52:35 [DEBUG   ] summary = ERROR
2014-02-27 11:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290421  13 56715 42755769 A  ERRORERROR'
2014-02-27 11:52:35 [DEBUG   ] Got command RPT from MCS: ref #290422
2014-02-27 11:52:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 11:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290422  77 56715 42755770 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 11:52:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 11:52:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 11:52:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 11:52:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 11:52:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 11:52:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 11:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 11:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 11:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 11:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 11:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 11:52:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-27 11:52:54 [DEBUG   ] Finished updating board flags in 1.571 seconds
2014-02-27 11:52:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 11:53:17 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-27 11:53:37 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 11:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 11:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 11:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 11:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 11:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 11:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 11:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 11:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 11:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 11:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 11:53:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 11:53:54 [DEBUG   ] Finished updating board flags in 1.418 seconds
2014-02-27 11:53:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 11:54:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 11:54:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 11:54:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 11:54:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 11:54:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 11:54:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 11:54:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 11:54:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 11:54:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 11:54:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 11:54:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 11:54:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 11:54:54 [DEBUG   ] Finished updating board flags in 1.541 seconds
2014-02-27 11:54:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-02-27 11:55:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 11:55:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 11:55:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 11:55:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 11:55:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 11:55:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 11:55:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 11:55:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 11:55:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 11:55:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 11:55:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 11:55:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 11:55:54 [DEBUG   ] Finished updating board flags in 1.553 seconds
2014-02-27 11:55:57 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 11:56:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 11:56:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 11:56:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 11:56:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 11:56:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 11:56:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 11:56:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 11:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 11:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 11:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 11:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 11:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 11:56:55 [DEBUG   ] Finished updating board flags in 2.191 seconds
2014-02-27 11:56:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 11:57:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 11:57:35 [DEBUG   ] Got command RPT from MCS: ref #290438
2014-02-27 11:57:35 [DEBUG   ] summary = ERROR
2014-02-27 11:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290438  13 56715 43055781 A  ERRORERROR'
2014-02-27 11:57:35 [DEBUG   ] Got command RPT from MCS: ref #290439
2014-02-27 11:57:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-02-27 11:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290439  77 56715 43055782 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-02-27 11:57:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 11:57:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 11:57:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 11:57:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 11:57:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 11:57:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 11:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 11:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 11:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 11:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 11:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 11:57:55 [DEBUG   ] Finished updating board flags in 1.899 seconds
2014-02-27 11:57:57 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-02-27 11:58:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-02-27 11:58:38 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-02-27 11:58:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 11:58:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 11:58:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 11:58:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 11:58:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 11:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 11:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 11:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 11:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 11:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 11:58:55 [DEBUG   ] Finished updating board flags in 1.829 seconds
2014-02-27 11:58:58 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-27 11:59:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 11:59:38 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 11:59:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 11:59:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 11:59:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 11:59:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 11:59:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 11:59:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 11:59:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 11:59:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 11:59:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 11:59:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 11:59:55 [DEBUG   ] Finished updating board flags in 1.784 seconds
2014-02-27 11:59:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 12:00:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 12:00:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 12:00:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 12:00:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 12:00:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 12:00:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 12:00:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 12:00:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 12:00:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 12:00:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 12:00:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 12:00:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 12:00:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 12:00:55 [DEBUG   ] Finished updating board flags in 1.606 seconds
2014-02-27 12:00:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 12:01:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 12:01:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 12:01:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 12:01:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 12:01:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 12:01:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 12:01:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 12:01:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 12:01:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 12:01:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 12:01:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 12:01:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 12:01:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-27 12:01:55 [DEBUG   ] Finished updating board flags in 1.643 seconds
2014-02-27 12:01:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 12:02:00 [DEBUG   ] Got command INI from MCS: ref #290455
2014-02-27 12:02:00 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2014-02-27 12:02:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   290455   8 56715 43320182 ABOOTING'
2014-02-27 12:02:24 [INFO    ] -------------------
2014-02-27 12:02:24 [INFO    ]  LWA board status
2014-02-27 12:02:24 [INFO    ] -------------------
2014-02-27 12:02:24 [INFO    ] DP 1: 2 lwa27
2014-02-27 12:02:24 [INFO    ] DP 1: 3 lwa24
2014-02-27 12:02:24 [INFO    ] DP 1: 4 lwa23
2014-02-27 12:02:24 [INFO    ] DP 1: 5 lwa18
2014-02-27 12:02:24 [INFO    ] DP 1: 6 lwa10
2014-02-27 12:02:24 [INFO    ] DP 1: 7 lwa32
2014-02-27 12:02:24 [INFO    ] DP 1: 8 lwa11
2014-02-27 12:02:24 [INFO    ] DP 1: 9 lwa30
2014-02-27 12:02:24 [INFO    ] DP 1: 10 lwa12
2014-02-27 12:02:24 [INFO    ] DP 1: 11 lwa8
2014-02-27 12:02:24 [INFO    ] DP 1: 12 lwa13
2014-02-27 12:02:24 [INFO    ] DP 1: 13 lwa26
2014-02-27 12:02:24 [INFO    ] DP 1: 14 lwa14
2014-02-27 12:02:24 [INFO    ] DP 1: 16 lwa22
2014-02-27 12:02:24 [INFO    ] DP 1: 17 lwa20
2014-02-27 12:02:24 [INFO    ] DP 1: 18 lwa1
2014-02-27 12:02:24 [INFO    ] DP 1: 19 lwa5
2014-02-27 12:02:24 [INFO    ] DP 1: 20 lwa25
2014-02-27 12:02:24 [INFO    ] DP 1: 21 lwa35
2014-02-27 12:02:24 [INFO    ] DP 1: 22 lwa19
2014-02-27 12:02:24 [INFO    ] DP 1: 23 lwa21
2014-02-27 12:02:24 [INFO    ] DP 1: 24 lwa6
2014-02-27 12:02:24 [INFO    ] DP 1: 25 lwa7
2014-02-27 12:02:24 [INFO    ] DP 1: 26 lwa33
2014-02-27 12:02:24 [INFO    ] DP 1: 27 lwa15
2014-02-27 12:02:24 [INFO    ] DP 1: 28 lwa28
2014-02-27 12:02:24 [INFO    ] DP 2: 1 lwa16
2014-02-27 12:02:24 [INFO    ] DP 2: 15 lwa34
2014-02-27 12:02:24 [INFO    ] Total of 28 boards
2014-02-27 12:02:24 [INFO    ] Total of 260 stands
2014-02-27 12:02:24 [INFO    ] -------------------
2014-02-27 12:02:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2014-02-27 12:02:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2014-02-27 12:02:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2014-02-27 12:02:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2014-02-27 12:02:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2014-02-27 12:02:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2014-02-27 12:02:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2014-02-27 12:02:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2014-02-27 12:02:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2014-02-27 12:02:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2014-02-27 12:02:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2014-02-27 12:02:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2014-02-27 12:02:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2014-02-27 12:02:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2014-02-27 12:02:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2014-02-27 12:02:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2014-02-27 12:02:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2014-02-27 12:02:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2014-02-27 12:02:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2014-02-27 12:02:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2014-02-27 12:02:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2014-02-27 12:02:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2014-02-27 12:02:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2014-02-27 12:02:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2014-02-27 12:02:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2014-02-27 12:02:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2014-02-27 12:02:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2014-02-27 12:02:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2014-02-27 12:02:31 [DEBUG   ] 2014-02-27 12:02:31 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19012
2014-02-27 12:02:31 [DEBUG   ] 2014-02-27 12:02:31 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19013
2014-02-27 12:02:31 [DEBUG   ] 2014-02-27 12:02:31 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19014
2014-02-27 12:02:31 [DEBUG   ] 2014-02-27 12:02:31 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19015
2014-02-27 12:02:31 [DEBUG   ] 2014-02-27 12:02:31 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19016
2014-02-27 12:02:31 [DEBUG   ] 2014-02-27 12:02:31 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19017
2014-02-27 12:02:31 [DEBUG   ] 2014-02-27 12:02:31 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19018
2014-02-27 12:02:31 [DEBUG   ] 2014-02-27 12:02:31 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19019
2014-02-27 12:02:31 [DEBUG   ] 2014-02-27 12:02:31 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19020
2014-02-27 12:02:31 [DEBUG   ] 2014-02-27 12:02:31 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19021
2014-02-27 12:02:31 [DEBUG   ] 2014-02-27 12:02:31 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19022
2014-02-27 12:02:31 [DEBUG   ] 2014-02-27 12:02:31 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19023
2014-02-27 12:02:31 [DEBUG   ] 2014-02-27 12:02:31 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19024
2014-02-27 12:02:31 [DEBUG   ] 2014-02-27 12:02:31 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19025
2014-02-27 12:02:31 [DEBUG   ] 2014-02-27 12:02:31 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19026
2014-02-27 12:02:31 [DEBUG   ] 2014-02-27 12:02:31 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19027
2014-02-27 12:02:31 [DEBUG   ] 2014-02-27 12:02:31 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19028
2014-02-27 12:02:31 [DEBUG   ] 2014-02-27 12:02:31 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19029
2014-02-27 12:02:31 [DEBUG   ] 2014-02-27 12:02:31 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19030
2014-02-27 12:02:31 [DEBUG   ] 2014-02-27 12:02:31 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19031
2014-02-27 12:02:31 [DEBUG   ] 2014-02-27 12:02:31 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19032
2014-02-27 12:02:31 [DEBUG   ] 2014-02-27 12:02:31 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19033
2014-02-27 12:02:31 [DEBUG   ] 2014-02-27 12:02:31 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19034
2014-02-27 12:02:31 [DEBUG   ] 2014-02-27 12:02:31 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19035
2014-02-27 12:02:31 [DEBUG   ] 2014-02-27 12:02:31 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19036
2014-02-27 12:02:31 [DEBUG   ] 2014-02-27 12:02:31 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19037
2014-02-27 12:02:35 [DEBUG   ] Got command RPT from MCS: ref #290456
2014-02-27 12:02:35 [DEBUG   ] summary = BOOTING
2014-02-27 12:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290456  15 56715 43355782 ABOOTINGBOOTING'
2014-02-27 12:02:35 [DEBUG   ] Got command RPT from MCS: ref #290457
2014-02-27 12:02:35 [DEBUG   ] info = Running INI sequence
2014-02-27 12:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290457  28 56715 43355782 ABOOTINGRunning INI sequence'
2014-02-27 12:02:44 [DEBUG   ] 2014-02-27 12:02:44 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19012 exited with status 0
2014-02-27 12:02:44 [DEBUG   ] 2014-02-27 12:02:44 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19013 exited with status 0
2014-02-27 12:02:44 [DEBUG   ] 2014-02-27 12:02:44 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19014 exited with status 0
2014-02-27 12:02:44 [DEBUG   ] 2014-02-27 12:02:44 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19015 exited with status 0
2014-02-27 12:02:44 [DEBUG   ] 2014-02-27 12:02:44 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19016 exited with status 0
2014-02-27 12:02:44 [DEBUG   ] 2014-02-27 12:02:44 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19017 exited with status 0
2014-02-27 12:02:44 [DEBUG   ] 2014-02-27 12:02:44 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19018 exited with status 0
2014-02-27 12:02:44 [DEBUG   ] 2014-02-27 12:02:44 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19019 exited with status 0
2014-02-27 12:02:44 [DEBUG   ] 2014-02-27 12:02:44 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19020 exited with status 0
2014-02-27 12:02:44 [DEBUG   ] 2014-02-27 12:02:44 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19021 exited with status 0
2014-02-27 12:02:44 [DEBUG   ] 2014-02-27 12:02:44 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19022 exited with status 0
2014-02-27 12:02:44 [DEBUG   ] 2014-02-27 12:02:44 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19023 exited with status 0
2014-02-27 12:02:44 [DEBUG   ] 2014-02-27 12:02:44 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19024 exited with status 0
2014-02-27 12:02:44 [DEBUG   ] 2014-02-27 12:02:44 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19025 exited with status 0
2014-02-27 12:02:44 [DEBUG   ] 2014-02-27 12:02:44 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19026 exited with status 0
2014-02-27 12:02:44 [DEBUG   ] 2014-02-27 12:02:44 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19027 exited with status 0
2014-02-27 12:02:44 [DEBUG   ] 2014-02-27 12:02:44 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19028 exited with status 0
2014-02-27 12:02:44 [DEBUG   ] 2014-02-27 12:02:44 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19029 exited with status 0
2014-02-27 12:02:44 [DEBUG   ] 2014-02-27 12:02:44 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19030 exited with status 0
2014-02-27 12:02:44 [DEBUG   ] 2014-02-27 12:02:44 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19031 exited with status 0
2014-02-27 12:02:44 [DEBUG   ] 2014-02-27 12:02:44 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19032 exited with status 0
2014-02-27 12:02:44 [DEBUG   ] 2014-02-27 12:02:44 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19033 exited with status 0
2014-02-27 12:02:44 [DEBUG   ] 2014-02-27 12:02:44 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19034 exited with status 0
2014-02-27 12:02:44 [DEBUG   ] 2014-02-27 12:02:44 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19035 exited with status 0
2014-02-27 12:02:44 [DEBUG   ] 2014-02-27 12:02:44 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19036 exited with status 0
2014-02-27 12:02:44 [DEBUG   ] 2014-02-27 12:02:44 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19037 exited with status 0
2014-02-27 12:02:44 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2014-02-27 12:02:44 [DEBUG   ] spawn_process: at 2014-02-27 12:02:44 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2014-02-27 12:02:44 [DEBUG   ] spawn_process: at 2014-02-27 12:02:44 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2014-02-27 12:02:44 [DEBUG   ] spawn_process: at 2014-02-27 12:02:44 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2014-02-27 12:02:44 [DEBUG   ] spawn_process: at 2014-02-27 12:02:44 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2014-02-27 12:02:44 [DEBUG   ] spawn_process: at 2014-02-27 12:02:44 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2014-02-27 12:02:44 [DEBUG   ] spawn_process: at 2014-02-27 12:02:44 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2014-02-27 12:02:44 [DEBUG   ] spawn_process: at 2014-02-27 12:02:44 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2014-02-27 12:02:44 [DEBUG   ] spawn_process: at 2014-02-27 12:02:44 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2014-02-27 12:02:44 [DEBUG   ] spawn_process: at 2014-02-27 12:02:44 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2014-02-27 12:02:44 [DEBUG   ] spawn_process: at 2014-02-27 12:02:44 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2014-02-27 12:02:44 [DEBUG   ] spawn_process: at 2014-02-27 12:02:44 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2014-02-27 12:02:44 [DEBUG   ] spawn_process: at 2014-02-27 12:02:44 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2014-02-27 12:02:44 [DEBUG   ] spawn_process: at 2014-02-27 12:02:44 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2014-02-27 12:02:44 [DEBUG   ] spawn_process: at 2014-02-27 12:02:44 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2014-02-27 12:02:44 [DEBUG   ] spawn_process: at 2014-02-27 12:02:44 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2014-02-27 12:02:44 [DEBUG   ] spawn_process: at 2014-02-27 12:02:44 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2014-02-27 12:02:44 [DEBUG   ] spawn_process: at 2014-02-27 12:02:44 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2014-02-27 12:02:44 [DEBUG   ] spawn_process: at 2014-02-27 12:02:44 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2014-02-27 12:02:44 [DEBUG   ] spawn_process: at 2014-02-27 12:02:44 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2014-02-27 12:02:44 [DEBUG   ] spawn_process: at 2014-02-27 12:02:44 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2014-02-27 12:02:44 [DEBUG   ] spawn_process: at 2014-02-27 12:02:44 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2014-02-27 12:02:44 [DEBUG   ] spawn_process: at 2014-02-27 12:02:44 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2014-02-27 12:02:44 [DEBUG   ] spawn_process: at 2014-02-27 12:02:44 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2014-02-27 12:02:44 [DEBUG   ] spawn_process: at 2014-02-27 12:02:44 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2014-02-27 12:02:44 [DEBUG   ] spawn_process: at 2014-02-27 12:02:44 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2014-02-27 12:02:44 [DEBUG   ] spawn_process: at 2014-02-27 12:02:44 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2014-02-27 12:02:44 [DEBUG   ] 2014-02-27 12:02:44 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 19064
2014-02-27 12:02:44 [DEBUG   ] 2014-02-27 12:02:44 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 19065
2014-02-27 12:02:49 [DEBUG   ] 2014-02-27 12:02:49 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 19064 exited with status 0
2014-02-27 12:02:49 [DEBUG   ] 2014-02-27 12:02:49 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 19065 exited with status 0
2014-02-27 12:02:49 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2014-02-27 12:02:49 [DEBUG   ] spawn_process: at 2014-02-27 12:02:49 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2014-02-27 12:02:49 [DEBUG   ] spawn_process: at 2014-02-27 12:02:49 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2014-02-27 12:02:49 [INFO    ] Setting Beam 1 xbars
2014-02-27 12:02:49 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2014-02-27 12:02:49 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2014-02-27 12:02:49 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2014-02-27 12:02:50 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2014-02-27 12:02:50 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2014-02-27 12:02:50 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2014-02-27 12:02:50 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2014-02-27 12:02:50 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2014-02-27 12:02:50 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2014-02-27 12:02:50 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2014-02-27 12:02:50 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2014-02-27 12:02:50 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2014-02-27 12:02:51 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2014-02-27 12:02:51 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2014-02-27 12:02:51 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2014-02-27 12:02:51 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2014-02-27 12:02:51 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2014-02-27 12:02:51 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2014-02-27 12:02:51 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2014-02-27 12:02:51 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2014-02-27 12:02:51 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2014-02-27 12:02:52 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2014-02-27 12:02:52 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2014-02-27 12:02:52 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2014-02-27 12:02:52 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2014-02-27 12:02:52 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2014-02-27 12:02:52 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2014-02-27 12:02:52 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2014-02-27 12:02:52 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2014-02-27 12:02:52 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2014-02-27 12:02:52 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2014-02-27 12:02:53 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2014-02-27 12:02:53 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2014-02-27 12:02:53 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2014-02-27 12:02:53 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2014-02-27 12:02:53 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2014-02-27 12:02:53 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2014-02-27 12:02:53 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2014-02-27 12:02:53 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2014-02-27 12:02:53 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2014-02-27 12:02:54 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2014-02-27 12:02:54 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2014-02-27 12:02:54 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2014-02-27 12:02:54 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2014-02-27 12:02:54 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2014-02-27 12:02:54 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2014-02-27 12:02:54 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2014-02-27 12:02:54 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2014-02-27 12:02:54 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2014-02-27 12:02:55 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2014-02-27 12:02:55 [INFO    ] Setting Beam 2 xbars
2014-02-27 12:02:55 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2014-02-27 12:02:55 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2014-02-27 12:02:55 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2014-02-27 12:02:55 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2014-02-27 12:02:55 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2014-02-27 12:02:55 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2014-02-27 12:02:55 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2014-02-27 12:02:55 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2014-02-27 12:02:56 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2014-02-27 12:02:56 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2014-02-27 12:02:56 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2014-02-27 12:02:56 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2014-02-27 12:02:56 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2014-02-27 12:02:56 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2014-02-27 12:02:56 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2014-02-27 12:02:56 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2014-02-27 12:02:56 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2014-02-27 12:02:56 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2014-02-27 12:02:57 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2014-02-27 12:02:57 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2014-02-27 12:02:57 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2014-02-27 12:02:57 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2014-02-27 12:02:57 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2014-02-27 12:02:57 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2014-02-27 12:02:57 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2014-02-27 12:02:57 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2014-02-27 12:02:57 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2014-02-27 12:02:58 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2014-02-27 12:02:58 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2014-02-27 12:02:58 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2014-02-27 12:02:58 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2014-02-27 12:02:58 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2014-02-27 12:02:58 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2014-02-27 12:02:58 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2014-02-27 12:02:58 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2014-02-27 12:02:58 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2014-02-27 12:02:59 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2014-02-27 12:02:59 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2014-02-27 12:02:59 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2014-02-27 12:02:59 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2014-02-27 12:02:59 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2014-02-27 12:02:59 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2014-02-27 12:02:59 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2014-02-27 12:02:59 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2014-02-27 12:02:59 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2014-02-27 12:03:00 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2014-02-27 12:03:00 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2014-02-27 12:03:00 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2014-02-27 12:03:00 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2014-02-27 12:03:00 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2014-02-27 12:03:00 [INFO    ] Setting Beam 3 xbars
2014-02-27 12:03:00 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2014-02-27 12:03:00 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2014-02-27 12:03:00 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2014-02-27 12:03:00 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2014-02-27 12:03:01 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2014-02-27 12:03:01 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2014-02-27 12:03:01 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2014-02-27 12:03:01 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2014-02-27 12:03:01 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2014-02-27 12:03:01 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2014-02-27 12:03:01 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2014-02-27 12:03:01 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2014-02-27 12:03:01 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2014-02-27 12:03:02 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2014-02-27 12:03:02 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2014-02-27 12:03:02 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2014-02-27 12:03:02 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2014-02-27 12:03:02 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2014-02-27 12:03:02 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2014-02-27 12:03:02 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2014-02-27 12:03:02 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2014-02-27 12:03:02 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2014-02-27 12:03:03 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2014-02-27 12:03:03 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2014-02-27 12:03:03 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2014-02-27 12:03:03 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2014-02-27 12:03:03 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2014-02-27 12:03:03 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2014-02-27 12:03:03 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2014-02-27 12:03:03 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2014-02-27 12:03:03 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2014-02-27 12:03:03 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2014-02-27 12:03:04 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2014-02-27 12:03:04 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2014-02-27 12:03:04 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2014-02-27 12:03:04 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2014-02-27 12:03:04 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2014-02-27 12:03:04 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2014-02-27 12:03:04 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2014-02-27 12:03:04 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2014-02-27 12:03:04 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2014-02-27 12:03:05 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2014-02-27 12:03:05 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2014-02-27 12:03:05 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2014-02-27 12:03:05 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2014-02-27 12:03:05 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2014-02-27 12:03:05 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2014-02-27 12:03:05 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2014-02-27 12:03:05 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2014-02-27 12:03:05 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2014-02-27 12:03:06 [INFO    ] Setting Beam 4 xbars
2014-02-27 12:03:06 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2014-02-27 12:03:06 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2014-02-27 12:03:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2014-02-27 12:03:06 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2014-02-27 12:03:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2014-02-27 12:03:06 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2014-02-27 12:03:06 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2014-02-27 12:03:06 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2014-02-27 12:03:06 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2014-02-27 12:03:07 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2014-02-27 12:03:07 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2014-02-27 12:03:07 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2014-02-27 12:03:07 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2014-02-27 12:03:07 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2014-02-27 12:03:07 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2014-02-27 12:03:07 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2014-02-27 12:03:07 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2014-02-27 12:03:07 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2014-02-27 12:03:08 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2014-02-27 12:03:08 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2014-02-27 12:03:08 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2014-02-27 12:03:08 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2014-02-27 12:03:08 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2014-02-27 12:03:08 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2014-02-27 12:03:08 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2014-02-27 12:03:08 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2014-02-27 12:03:08 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2014-02-27 12:03:08 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2014-02-27 12:03:09 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2014-02-27 12:03:09 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2014-02-27 12:03:09 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2014-02-27 12:03:09 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2014-02-27 12:03:09 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2014-02-27 12:03:09 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2014-02-27 12:03:09 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2014-02-27 12:03:09 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2014-02-27 12:03:09 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2014-02-27 12:03:10 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2014-02-27 12:03:10 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2014-02-27 12:03:10 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2014-02-27 12:03:10 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2014-02-27 12:03:10 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2014-02-27 12:03:10 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2014-02-27 12:03:10 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2014-02-27 12:03:10 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2014-02-27 12:03:10 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2014-02-27 12:03:11 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2014-02-27 12:03:11 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2014-02-27 12:03:11 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2014-02-27 12:03:11 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2014-02-27 12:03:11 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2014-02-27 12:03:11 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2014-02-27 12:03:11 [INFO    ] All xbars set
2014-02-27 12:03:11 [INFO    ] Setting adder chain routing for all beams
2014-02-27 12:03:16 [INFO    ] Setting beam ids
2014-02-27 12:03:26 [INFO    ] Starting beam delay calibration
2014-02-27 12:03:38 [INFO    ] Beam 1 latency is 5722
2014-02-27 12:03:38 [INFO    ] Beam 2 latency is 5755
2014-02-27 12:03:38 [INFO    ] Beam 3 latency is 5741
2014-02-27 12:03:38 [INFO    ] Beam 4 latency is 5726
2014-02-27 12:03:38 [INFO    ] Stop calibration
2014-02-27 12:03:46 [INFO    ] Beam delay calibration successful
2014-02-27 12:03:46 [INFO    ] Calibration passed
2014-02-27 12:03:46 [DEBUG   ] spawn_process: at 2014-02-27 12:03:46 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2014-02-27 12:03:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2014-02-27 12:03:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2014-02-27 12:03:46 [DEBUG   ] spawn_process: at 2014-02-27 12:03:46 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2014-02-27 12:03:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2014-02-27 12:03:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2014-02-27 12:03:46 [DEBUG   ] spawn_process: at 2014-02-27 12:03:46 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2014-02-27 12:03:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2014-02-27 12:03:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2014-02-27 12:03:46 [DEBUG   ] spawn_process: at 2014-02-27 12:03:46 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2014-02-27 12:03:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2014-02-27 12:03:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2014-02-27 12:03:46 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2014-02-27 12:03:47 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 285 ms (1393502627.287 s) with PID 20639 and time 1393502628
2014-02-27 12:03:47 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2014-02-27 12:03:47 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 372 ms (1393502627.375 s) with PID 20642 and time 1393502628
2014-02-27 12:03:48 [DEBUG   ] Finished updating ant stats in 0.873 seconds
2014-02-27 12:03:48 [INFO    ] Started antennas statistics background thread
2014-02-27 12:03:48 [INFO    ] Started board flags background thread
2014-02-27 12:03:48 [INFO    ] Started BAM background thread
2014-02-27 12:03:48 [INFO    ] Finished the INI process (ref. #290455) in 108.316 s
2014-02-27 12:03:49 [DEBUG   ] Finished updating board flags in 1.059 seconds
2014-02-27 12:04:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:04:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:04:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:04:49 [DEBUG   ] Finished updating board flags in 0.988 seconds
2014-02-27 12:05:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:05:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:05:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 196000019
2014-02-27 12:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 196000019
2014-02-27 12:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 196000019
2014-02-27 12:05:50 [DEBUG   ] Finished updating board flags in 1.876 seconds
2014-02-27 12:06:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:06:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:06:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999783
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999783
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999783
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999783
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-02-27 12:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999783
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999725
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999725
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999725
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999725
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-02-27 12:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-02-27 12:06:50 [DEBUG   ] Finished updating board flags in 1.748 seconds
2014-02-27 12:07:00 [DEBUG   ] Got command RPT from MCS: ref #290473
2014-02-27 12:07:00 [DEBUG   ] summary = NORMAL
2014-02-27 12:07:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290473  14 56715 43620185 A NORMALNORMAL'
2014-02-27 12:07:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:07:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:07:35 [DEBUG   ] Got command RPT from MCS: ref #290474
2014-02-27 12:07:35 [DEBUG   ] summary = NORMAL
2014-02-27 12:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290474  14 56715 43655777 A NORMALNORMAL'
2014-02-27 12:07:35 [DEBUG   ] Got command RPT from MCS: ref #290475
2014-02-27 12:07:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 12:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290475  48 56715 43655778 A NORMALSystem calibrated and operating normally'
2014-02-27 12:07:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999941
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2014-02-27 12:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2014-02-27 12:07:49 [DEBUG   ] Finished updating board flags in 1.067 seconds
2014-02-27 12:08:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:08:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:08:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-02-27 12:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-02-27 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-02-27 12:08:50 [DEBUG   ] Finished updating board flags in 1.560 seconds
2014-02-27 12:09:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:09:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:09:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:09:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 12:09:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 12:09:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 12:09:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 12:09:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 12:09:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-27 12:09:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-02-27 12:09:50 [DEBUG   ] Finished updating board flags in 1.359 seconds
2014-02-27 12:10:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:10:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:10:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:10:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 12:10:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 12:10:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 12:10:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 12:10:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 12:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 12:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 12:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 12:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 12:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 12:10:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 12:10:50 [DEBUG   ] Finished updating board flags in 1.267 seconds
2014-02-27 12:11:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:11:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:11:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:11:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 12:11:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 12:11:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 12:11:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 12:11:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 12:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 12:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 12:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 12:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 12:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 12:11:50 [DEBUG   ] Finished updating board flags in 1.212 seconds
2014-02-27 12:12:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:12:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:12:35 [DEBUG   ] Got command RPT from MCS: ref #290491
2014-02-27 12:12:35 [DEBUG   ] summary = NORMAL
2014-02-27 12:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290491  14 56715 43955777 A NORMALNORMAL'
2014-02-27 12:12:35 [DEBUG   ] Got command RPT from MCS: ref #290492
2014-02-27 12:12:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 12:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290492  48 56715 43955778 A NORMALSystem calibrated and operating normally'
2014-02-27 12:12:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:12:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 12:12:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 12:12:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 12:12:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 12:12:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 12:12:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 12:12:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 12:12:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 12:12:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 12:12:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 12:12:50 [DEBUG   ] Finished updating board flags in 1.130 seconds
2014-02-27 12:13:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:13:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:13:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 12:13:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 12:13:50 [DEBUG   ] Finished updating board flags in 1.028 seconds
2014-02-27 12:14:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:14:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:14:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 12:14:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 12:14:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 12:14:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 12:14:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 12:14:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 12:14:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 12:14:51 [DEBUG   ] Finished updating board flags in 2.004 seconds
2014-02-27 12:15:00 [DEBUG   ] Got command TBN from MCS: ref #290508
2014-02-27 12:15:00 [DEBUG   ] spawn_process: at 2014-02-27 12:15:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '1', '1393503301']
2014-02-27 12:15:00 [DEBUG   ] spawn_process: at 2014-02-27 12:15:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '2', '1393503301']
2014-02-27 12:15:00 [DEBUG   ] tbn = exited with status True, code 0x00
2014-02-27 12:15:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   290508   8 56715 44100190 A NORMAL'
2014-02-27 12:15:00 [DEBUG   ] spawn_process: at 2014-02-27 12:15:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '3', '1393503301']
2014-02-27 12:15:00 [DEBUG   ] spawn_process: at 2014-02-27 12:15:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '4', '1393503301']
2014-02-27 12:15:00 [DEBUG   ] spawn_process: at 2014-02-27 12:15:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '5', '1393503301']
2014-02-27 12:15:00 [DEBUG   ] spawn_process: at 2014-02-27 12:15:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '6', '1393503301']
2014-02-27 12:15:00 [DEBUG   ] spawn_process: at 2014-02-27 12:15:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '7', '1393503301']
2014-02-27 12:15:00 [DEBUG   ] spawn_process: at 2014-02-27 12:15:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '8', '1393503301']
2014-02-27 12:15:00 [DEBUG   ] spawn_process: at 2014-02-27 12:15:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '9', '1393503301']
2014-02-27 12:15:00 [DEBUG   ] spawn_process: at 2014-02-27 12:15:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '10', '1393503301']
2014-02-27 12:15:00 [DEBUG   ] spawn_process: at 2014-02-27 12:15:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '11', '1393503301']
2014-02-27 12:15:00 [DEBUG   ] spawn_process: at 2014-02-27 12:15:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '12', '1393503301']
2014-02-27 12:15:00 [DEBUG   ] spawn_process: at 2014-02-27 12:15:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '13', '1393503301']
2014-02-27 12:15:00 [DEBUG   ] spawn_process: at 2014-02-27 12:15:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '14', '1393503301']
2014-02-27 12:15:00 [DEBUG   ] spawn_process: at 2014-02-27 12:15:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '15', '1393503301']
2014-02-27 12:15:00 [DEBUG   ] spawn_process: at 2014-02-27 12:15:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '16', '1393503301']
2014-02-27 12:15:00 [DEBUG   ] spawn_process: at 2014-02-27 12:15:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '17', '1393503301']
2014-02-27 12:15:00 [DEBUG   ] spawn_process: at 2014-02-27 12:15:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '18', '1393503301']
2014-02-27 12:15:00 [DEBUG   ] spawn_process: at 2014-02-27 12:15:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '19', '1393503301']
2014-02-27 12:15:00 [DEBUG   ] spawn_process: at 2014-02-27 12:15:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '20', '1393503301']
2014-02-27 12:15:00 [DEBUG   ] spawn_process: at 2014-02-27 12:15:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '21', '1393503301']
2014-02-27 12:15:00 [DEBUG   ] spawn_process: at 2014-02-27 12:15:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '22', '1393503301']
2014-02-27 12:15:00 [DEBUG   ] spawn_process: at 2014-02-27 12:15:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '23', '1393503301']
2014-02-27 12:15:00 [DEBUG   ] spawn_process: at 2014-02-27 12:15:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '24', '1393503301']
2014-02-27 12:15:00 [DEBUG   ] spawn_process: at 2014-02-27 12:15:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '25', '1393503301']
2014-02-27 12:15:00 [DEBUG   ] spawn_process: at 2014-02-27 12:15:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '26', '1393503301']
2014-02-27 12:15:00 [INFO    ] Finished spawning TBN in 0.049 s
2014-02-27 12:15:08 [DEBUG   ] Finished updating ant stats in 0.872 seconds
2014-02-27 12:15:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 12:15:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 12:15:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 12:15:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 12:15:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 12:15:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 12:15:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 12:15:50 [DEBUG   ] Finished updating board flags in 1.314 seconds
2014-02-27 12:16:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 12:16:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 12:16:48 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 12:16:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 12:16:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 12:16:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 12:16:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 12:16:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 12:16:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 12:16:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-27 12:16:51 [DEBUG   ] Finished updating board flags in 2.092 seconds
2014-02-27 12:17:08 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2014-02-27 12:17:29 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-27 12:17:35 [DEBUG   ] Got command RPT from MCS: ref #290509
2014-02-27 12:17:35 [DEBUG   ] summary = NORMAL
2014-02-27 12:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290509  14 56715 44255781 A NORMALNORMAL'
2014-02-27 12:17:35 [DEBUG   ] Got command RPT from MCS: ref #290510
2014-02-27 12:17:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 12:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290510  48 56715 44255782 A NORMALSystem calibrated and operating normally'
2014-02-27 12:17:49 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-27 12:17:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 12:17:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 12:17:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 12:17:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 12:17:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 12:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 12:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 12:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 12:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 12:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 12:17:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-27 12:17:51 [DEBUG   ] Finished updating board flags in 1.982 seconds
2014-02-27 12:18:09 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-02-27 12:18:29 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 12:18:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 12:18:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 12:18:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 12:18:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 12:18:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 12:18:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 12:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 12:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 12:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 12:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 12:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 12:18:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-27 12:18:51 [DEBUG   ] Finished updating board flags in 1.817 seconds
2014-02-27 12:19:09 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-27 12:19:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:19:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 12:19:51 [DEBUG   ] Finished updating board flags in 1.787 seconds
2014-02-27 12:20:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 12:20:29 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2014-02-27 12:20:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 12:20:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-27 12:20:51 [DEBUG   ] Finished updating board flags in 1.613 seconds
2014-02-27 12:21:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 12:21:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 12:21:49 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-02-27 12:21:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 12:21:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 12:21:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 12:21:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 12:21:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 12:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 12:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 12:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 12:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 12:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 12:21:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-27 12:21:51 [DEBUG   ] Finished updating board flags in 1.609 seconds
2014-02-27 12:22:10 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2014-02-27 12:22:30 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-02-27 12:22:35 [DEBUG   ] Got command RPT from MCS: ref #290526
2014-02-27 12:22:35 [DEBUG   ] summary = NORMAL
2014-02-27 12:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290526  14 56715 44555785 A NORMALNORMAL'
2014-02-27 12:22:35 [DEBUG   ] Got command RPT from MCS: ref #290527
2014-02-27 12:22:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 12:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290527  48 56715 44555786 A NORMALSystem calibrated and operating normally'
2014-02-27 12:22:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 12:22:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 12:22:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 12:22:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 12:22:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 12:22:50 [DEBUG   ] Finished updating ant stats in 1.252 seconds
2014-02-27 12:22:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 12:22:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 12:22:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 12:22:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 12:22:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 12:22:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 12:22:51 [DEBUG   ] Finished updating board flags in 1.582 seconds
2014-02-27 12:23:10 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2014-02-27 12:23:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 12:23:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-02-27 12:23:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-02-27 12:23:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-02-27 12:23:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-02-27 12:23:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-02-27 12:23:50 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2014-02-27 12:23:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-02-27 12:23:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-02-27 12:23:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-02-27 12:23:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-02-27 12:23:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-02-27 12:23:51 [DEBUG   ] Finished updating board flags in 1.416 seconds
2014-02-27 12:24:10 [DEBUG   ] Finished updating ant stats in 0.954 seconds
2014-02-27 12:24:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2014-02-27 12:24:50 [DEBUG   ] Finished updating ant stats in 0.852 seconds
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2014-02-27 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2014-02-27 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2014-02-27 12:24:51 [DEBUG   ] Finished updating board flags in 1.408 seconds
2014-02-27 12:25:10 [DEBUG   ] Finished updating ant stats in 0.755 seconds
2014-02-27 12:25:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 12:25:50 [DEBUG   ] Finished updating ant stats in 0.641 seconds
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-02-27 12:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-02-27 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-02-27 12:25:51 [DEBUG   ] Finished updating board flags in 1.415 seconds
2014-02-27 12:26:10 [DEBUG   ] Finished updating ant stats in 0.564 seconds
2014-02-27 12:26:31 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-02-27 12:26:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 12:26:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 12:26:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 12:26:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 12:26:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 12:26:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 12:26:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 12:26:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 12:26:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 12:26:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 12:26:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-02-27 12:26:51 [DEBUG   ] Finished updating ant stats in 1.251 seconds
2014-02-27 12:26:51 [DEBUG   ] Finished updating board flags in 1.430 seconds
2014-02-27 12:27:11 [DEBUG   ] Finished updating ant stats in 1.160 seconds
2014-02-27 12:27:31 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2014-02-27 12:27:35 [DEBUG   ] Got command RPT from MCS: ref #290543
2014-02-27 12:27:35 [DEBUG   ] summary = NORMAL
2014-02-27 12:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290543  14 56715 44855789 A NORMALNORMAL'
2014-02-27 12:27:35 [DEBUG   ] Got command RPT from MCS: ref #290544
2014-02-27 12:27:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 12:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290544  48 56715 44855790 A NORMALSystem calibrated and operating normally'
2014-02-27 12:27:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 12:27:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 12:27:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 12:27:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 12:27:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 12:27:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 12:27:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 12:27:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 12:27:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 12:27:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 12:27:51 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2014-02-27 12:27:51 [DEBUG   ] Finished updating board flags in 1.452 seconds
2014-02-27 12:28:11 [DEBUG   ] Finished updating ant stats in 0.760 seconds
2014-02-27 12:28:31 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 12:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-02-27 12:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-02-27 12:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-02-27 12:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-02-27 12:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-02-27 12:28:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-02-27 12:28:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-02-27 12:28:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-02-27 12:28:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-02-27 12:28:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-02-27 12:28:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-27 12:28:51 [DEBUG   ] Finished updating ant stats in 0.644 seconds
2014-02-27 12:28:51 [DEBUG   ] Finished updating board flags in 1.451 seconds
2014-02-27 12:29:11 [DEBUG   ] Finished updating ant stats in 0.554 seconds
2014-02-27 12:29:32 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 196000019
2014-02-27 12:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 196000019
2014-02-27 12:29:51 [DEBUG   ] Finished updating ant stats in 0.448 seconds
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 196000019
2014-02-27 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 196000019
2014-02-27 12:29:51 [DEBUG   ] Finished updating board flags in 1.471 seconds
2014-02-27 12:30:12 [DEBUG   ] Finished updating ant stats in 1.354 seconds
2014-02-27 12:30:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-02-27 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-02-27 12:30:52 [DEBUG   ] Finished updating ant stats in 1.248 seconds
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-02-27 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-02-27 12:30:52 [DEBUG   ] Finished updating board flags in 2.267 seconds
2014-02-27 12:31:12 [DEBUG   ] Finished updating ant stats in 1.155 seconds
2014-02-27 12:31:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 12:31:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 12:31:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 12:31:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 12:31:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 12:31:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 12:31:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 12:31:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 12:31:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 12:31:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 12:31:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 12:31:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-27 12:31:52 [DEBUG   ] Finished updating ant stats in 1.045 seconds
2014-02-27 12:31:52 [DEBUG   ] Finished updating board flags in 2.176 seconds
2014-02-27 12:32:12 [DEBUG   ] Finished updating ant stats in 0.961 seconds
2014-02-27 12:32:32 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 12:32:35 [DEBUG   ] Got command RPT from MCS: ref #290560
2014-02-27 12:32:35 [DEBUG   ] summary = NORMAL
2014-02-27 12:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290560  14 56715 45155789 A NORMALNORMAL'
2014-02-27 12:32:35 [DEBUG   ] Got command RPT from MCS: ref #290561
2014-02-27 12:32:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 12:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290561  48 56715 45155790 A NORMALSystem calibrated and operating normally'
2014-02-27 12:32:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 12:32:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 12:32:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 12:32:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 12:32:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 12:32:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 12:32:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 12:32:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 12:32:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 12:32:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 12:32:52 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2014-02-27 12:32:52 [DEBUG   ] Finished updating board flags in 2.014 seconds
2014-02-27 12:33:12 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2014-02-27 12:33:33 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-02-27 12:33:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 12:33:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 12:33:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 12:33:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 12:33:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 12:33:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 12:33:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 12:33:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 12:33:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 12:33:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 12:33:52 [DEBUG   ] Finished updating board flags in 1.957 seconds
2014-02-27 12:33:53 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-27 12:34:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 12:34:33 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 12:34:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 12:34:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 12:34:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 12:34:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 12:34:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 12:34:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 12:34:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 12:34:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 12:34:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 12:34:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 12:34:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 12:34:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-27 12:34:52 [DEBUG   ] Finished updating board flags in 1.833 seconds
2014-02-27 12:34:53 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-02-27 12:35:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 12:35:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 12:35:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 12:35:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 12:35:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 12:35:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 12:35:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 12:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 12:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 12:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 12:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 12:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 12:35:52 [DEBUG   ] Finished updating board flags in 1.797 seconds
2014-02-27 12:35:53 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 12:36:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:36:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 12:36:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 12:36:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 12:36:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 12:36:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 12:36:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 12:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 12:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 12:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 12:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 12:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 12:36:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 12:36:52 [DEBUG   ] Finished updating board flags in 1.602 seconds
2014-02-27 12:36:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 12:37:13 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 12:37:33 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-02-27 12:37:35 [DEBUG   ] Got command RPT from MCS: ref #290577
2014-02-27 12:37:35 [DEBUG   ] summary = NORMAL
2014-02-27 12:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290577  14 56715 45455789 A NORMALNORMAL'
2014-02-27 12:37:35 [DEBUG   ] Got command RPT from MCS: ref #290578
2014-02-27 12:37:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 12:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290578  48 56715 45455790 A NORMALSystem calibrated and operating normally'
2014-02-27 12:37:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 12:37:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 12:37:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 12:37:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 12:37:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 12:37:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 12:37:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 12:37:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 12:37:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 12:37:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 12:37:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 12:37:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-27 12:37:52 [DEBUG   ] Finished updating board flags in 1.631 seconds
2014-02-27 12:37:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 12:38:13 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 12:38:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 12:38:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 12:38:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 12:38:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 12:38:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 12:38:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 12:38:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 12:38:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 12:38:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 12:38:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 12:38:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 12:38:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-27 12:38:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 12:38:52 [DEBUG   ] Finished updating board flags in 1.616 seconds
2014-02-27 12:38:53 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-02-27 12:39:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 12:39:34 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-02-27 12:39:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 12:39:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 12:39:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 12:39:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 12:39:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 12:39:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 12:39:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 12:39:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 12:39:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 12:39:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 12:39:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 12:39:52 [DEBUG   ] Finished updating board flags in 1.508 seconds
2014-02-27 12:39:54 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-27 12:40:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 12:40:34 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 12:40:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 12:40:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 12:40:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 12:40:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 12:40:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 12:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 12:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 12:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 12:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 12:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 12:40:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 12:40:52 [DEBUG   ] Finished updating board flags in 1.418 seconds
2014-02-27 12:40:54 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 12:41:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 12:41:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 12:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 12:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 12:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 12:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 12:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 12:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 12:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 12:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 12:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 12:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 12:41:52 [DEBUG   ] Finished updating board flags in 1.388 seconds
2014-02-27 12:41:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 12:42:14 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 12:42:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:42:35 [DEBUG   ] Got command RPT from MCS: ref #290594
2014-02-27 12:42:35 [DEBUG   ] summary = NORMAL
2014-02-27 12:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290594  14 56715 45755785 A NORMALNORMAL'
2014-02-27 12:42:35 [DEBUG   ] Got command RPT from MCS: ref #290595
2014-02-27 12:42:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 12:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290595  48 56715 45755786 A NORMALSystem calibrated and operating normally'
2014-02-27 12:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 12:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 12:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 12:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 12:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 12:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 12:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 12:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 12:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 12:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 12:42:52 [DEBUG   ] Finished updating board flags in 1.366 seconds
2014-02-27 12:42:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:43:14 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-27 12:43:34 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 12:43:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 12:43:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 12:43:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 12:43:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 12:43:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 12:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 12:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 12:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 12:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 12:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 12:43:53 [DEBUG   ] Finished updating board flags in 2.050 seconds
2014-02-27 12:43:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 12:44:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 12:44:34 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 12:44:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 12:44:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 12:44:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 12:44:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 12:44:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 12:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 12:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 12:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 12:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 12:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 12:44:53 [DEBUG   ] Finished updating board flags in 1.982 seconds
2014-02-27 12:44:54 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 12:45:15 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-02-27 12:45:35 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-27 12:45:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 12:45:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 12:45:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 12:45:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 12:45:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 12:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 12:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 12:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 12:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 12:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 12:45:53 [DEBUG   ] Finished updating board flags in 1.812 seconds
2014-02-27 12:45:55 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 12:46:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 12:46:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 12:46:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 12:46:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 12:46:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 12:46:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 12:46:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 12:46:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 12:46:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 12:46:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 12:46:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 12:46:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 12:46:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 12:46:53 [DEBUG   ] Finished updating board flags in 1.815 seconds
2014-02-27 12:46:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 12:47:15 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 12:47:35 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-02-27 12:47:35 [DEBUG   ] Got command RPT from MCS: ref #290611
2014-02-27 12:47:35 [DEBUG   ] summary = NORMAL
2014-02-27 12:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290611  14 56715 46055789 A NORMALNORMAL'
2014-02-27 12:47:35 [DEBUG   ] Got command RPT from MCS: ref #290612
2014-02-27 12:47:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 12:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290612  48 56715 46055790 A NORMALSystem calibrated and operating normally'
2014-02-27 12:47:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 12:47:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 12:47:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 12:47:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 12:47:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 12:47:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 12:47:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 12:47:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 12:47:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 12:47:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 12:47:53 [DEBUG   ] Finished updating board flags in 1.784 seconds
2014-02-27 12:47:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 12:48:15 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-27 12:48:35 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 12:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 12:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 12:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 12:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 12:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 12:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 12:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 12:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 12:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 12:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 12:48:53 [DEBUG   ] Finished updating board flags in 1.610 seconds
2014-02-27 12:48:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 12:49:16 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-27 12:49:36 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-27 12:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 12:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 12:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 12:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 12:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 12:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 12:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 12:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 12:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 12:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 12:49:53 [DEBUG   ] Finished updating board flags in 1.608 seconds
2014-02-27 12:49:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 12:50:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 12:50:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 12:50:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 12:50:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 12:50:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 12:50:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 12:50:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 12:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 12:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 12:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 12:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 12:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 12:50:53 [DEBUG   ] Finished updating board flags in 1.631 seconds
2014-02-27 12:50:56 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2014-02-27 12:51:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 12:51:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 12:51:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 12:51:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 12:51:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 12:51:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 12:51:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 12:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 12:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 12:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 12:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 12:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 12:51:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 12:51:53 [DEBUG   ] Finished updating board flags in 1.619 seconds
2014-02-27 12:51:56 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-02-27 12:52:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 12:52:35 [DEBUG   ] Got command RPT from MCS: ref #290628
2014-02-27 12:52:35 [DEBUG   ] summary = NORMAL
2014-02-27 12:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290628  14 56715 46355790 A NORMALNORMAL'
2014-02-27 12:52:35 [DEBUG   ] Got command RPT from MCS: ref #290629
2014-02-27 12:52:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 12:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290629  48 56715 46355790 A NORMALSystem calibrated and operating normally'
2014-02-27 12:52:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:52:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 12:52:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 12:52:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 12:52:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 12:52:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 12:52:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 12:52:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 12:52:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 12:52:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 12:52:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 12:52:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-27 12:52:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-02-27 12:52:53 [DEBUG   ] Finished updating board flags in 1.536 seconds
2014-02-27 12:52:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 12:53:16 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-27 12:53:36 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 12:53:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 12:53:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 12:53:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 12:53:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 12:53:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 12:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 12:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 12:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 12:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 12:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 12:53:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 12:53:53 [DEBUG   ] Finished updating board flags in 1.429 seconds
2014-02-27 12:53:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 12:54:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 12:54:36 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-27 12:54:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 12:54:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 12:54:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 12:54:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 12:54:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 12:54:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 12:54:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 12:54:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 12:54:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 12:54:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 12:54:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-27 12:54:53 [DEBUG   ] Finished updating board flags in 1.428 seconds
2014-02-27 12:54:56 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 12:55:17 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-02-27 12:55:37 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-02-27 12:55:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 12:55:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 12:55:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 12:55:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 12:55:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 12:55:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 12:55:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 12:55:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 12:55:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 12:55:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 12:55:53 [DEBUG   ] Finished updating board flags in 1.431 seconds
2014-02-27 12:55:57 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-02-27 12:56:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 12:56:37 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-02-27 12:56:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 12:56:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 12:56:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 12:56:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 12:56:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 12:56:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 12:56:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 12:56:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 12:56:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 12:56:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 12:56:53 [DEBUG   ] Finished updating board flags in 1.428 seconds
2014-02-27 12:56:57 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 12:57:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 12:57:35 [DEBUG   ] Got command RPT from MCS: ref #290645
2014-02-27 12:57:35 [DEBUG   ] summary = NORMAL
2014-02-27 12:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290645  14 56715 46655785 A NORMALNORMAL'
2014-02-27 12:57:35 [DEBUG   ] Got command RPT from MCS: ref #290646
2014-02-27 12:57:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 12:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290646  48 56715 46655786 A NORMALSystem calibrated and operating normally'
2014-02-27 12:57:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 12:57:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 12:57:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 12:57:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 12:57:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 12:57:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 12:57:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 12:57:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 12:57:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 12:57:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 12:57:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 12:57:53 [DEBUG   ] Finished updating board flags in 1.432 seconds
2014-02-27 12:57:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-02-27 12:58:17 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 12:58:37 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-02-27 12:58:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 12:58:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 12:58:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 12:58:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 12:58:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 12:58:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 12:58:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 12:58:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 12:58:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 12:58:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 12:58:53 [DEBUG   ] Finished updating board flags in 1.441 seconds
2014-02-27 12:58:57 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 12:59:18 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-02-27 12:59:38 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-27 12:59:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 12:59:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 12:59:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 12:59:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 12:59:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 12:59:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 12:59:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 12:59:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 12:59:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 12:59:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 12:59:53 [DEBUG   ] Finished updating board flags in 1.438 seconds
2014-02-27 12:59:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 13:00:18 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-27 13:00:38 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 13:00:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 13:00:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 13:00:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 13:00:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 13:00:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 13:00:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 13:00:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 13:00:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 13:00:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 13:00:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 13:00:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 13:00:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 13:00:53 [DEBUG   ] Finished updating board flags in 1.446 seconds
2014-02-27 13:00:58 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-02-27 13:01:18 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-27 13:01:38 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 13:01:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 13:01:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 13:01:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 13:01:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 13:01:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 13:01:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 13:01:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 13:01:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 13:01:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 13:01:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 13:01:54 [DEBUG   ] Finished updating board flags in 2.182 seconds
2014-02-27 13:01:58 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 13:02:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 13:02:35 [DEBUG   ] Got command RPT from MCS: ref #290662
2014-02-27 13:02:35 [DEBUG   ] summary = NORMAL
2014-02-27 13:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290662  14 56715 46955790 A NORMALNORMAL'
2014-02-27 13:02:35 [DEBUG   ] Got command RPT from MCS: ref #290663
2014-02-27 13:02:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 13:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290663  48 56715 46955790 A NORMALSystem calibrated and operating normally'
2014-02-27 13:02:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 13:02:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 13:02:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 13:02:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 13:02:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 13:02:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 13:02:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 13:02:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 13:02:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 13:02:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 13:02:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 13:02:54 [DEBUG   ] Finished updating board flags in 1.967 seconds
2014-02-27 13:02:58 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-02-27 13:03:18 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 13:03:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 13:03:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 13:03:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 13:03:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 13:03:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 13:03:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 13:03:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 13:03:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 13:03:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 13:03:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 13:03:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 13:03:54 [DEBUG   ] Finished updating board flags in 1.823 seconds
2014-02-27 13:03:59 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-27 13:04:19 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-02-27 13:04:39 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-27 13:04:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 13:04:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 13:04:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 13:04:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 13:04:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 13:04:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 13:04:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 13:04:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 13:04:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 13:04:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 13:04:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 13:04:54 [DEBUG   ] Finished updating board flags in 1.791 seconds
2014-02-27 13:04:59 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-27 13:05:19 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 13:05:39 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 13:05:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 13:05:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 13:05:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 13:05:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 13:05:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 13:05:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 13:05:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 13:05:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 13:05:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 13:05:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 13:05:54 [DEBUG   ] Finished updating board flags in 1.619 seconds
2014-02-27 13:05:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 13:06:19 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-27 13:06:39 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 13:06:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 13:06:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 13:06:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 13:06:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 13:06:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 13:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 13:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 13:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 13:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 13:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 13:06:54 [DEBUG   ] Finished updating board flags in 1.583 seconds
2014-02-27 13:06:59 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 13:07:20 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-02-27 13:07:35 [DEBUG   ] Got command RPT from MCS: ref #290679
2014-02-27 13:07:35 [DEBUG   ] summary = NORMAL
2014-02-27 13:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290679  14 56715 47255793 A NORMALNORMAL'
2014-02-27 13:07:35 [DEBUG   ] Got command RPT from MCS: ref #290680
2014-02-27 13:07:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 13:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290680  48 56715 47255794 A NORMALSystem calibrated and operating normally'
2014-02-27 13:07:39 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-02-27 13:07:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 13:07:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 13:07:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 13:07:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 13:07:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 13:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 13:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 13:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 13:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 13:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 13:07:54 [DEBUG   ] Finished updating board flags in 1.411 seconds
2014-02-27 13:08:00 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-02-27 13:08:20 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-27 13:08:40 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 13:08:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 13:08:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 13:08:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 13:08:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 13:08:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 13:08:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 13:08:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 13:08:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 13:08:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 13:08:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 13:08:54 [DEBUG   ] Finished updating board flags in 1.414 seconds
2014-02-27 13:09:00 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 13:09:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 13:09:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 13:09:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 13:09:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 13:09:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 13:09:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 13:09:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 13:09:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 13:09:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 13:09:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 13:09:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 13:09:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 13:09:54 [DEBUG   ] Finished updating board flags in 1.378 seconds
2014-02-27 13:10:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-02-27 13:10:20 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 13:10:40 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 13:10:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 13:10:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 13:10:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 13:10:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 13:10:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 13:10:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 13:10:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 13:10:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 13:10:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 13:10:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 13:10:54 [DEBUG   ] Finished updating board flags in 1.370 seconds
2014-02-27 13:11:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-02-27 13:11:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 13:11:40 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-02-27 13:11:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 13:11:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 13:11:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 13:11:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 13:11:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 13:11:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 13:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 13:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 13:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 13:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 13:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 13:11:55 [DEBUG   ] Finished updating board flags in 2.058 seconds
2014-02-27 13:12:00 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-02-27 13:12:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-02-27 13:12:35 [DEBUG   ] Got command RPT from MCS: ref #290696
2014-02-27 13:12:35 [DEBUG   ] summary = NORMAL
2014-02-27 13:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290696  14 56715 47555793 A NORMALNORMAL'
2014-02-27 13:12:35 [DEBUG   ] Got command RPT from MCS: ref #290697
2014-02-27 13:12:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 13:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290697  48 56715 47555794 A NORMALSystem calibrated and operating normally'
2014-02-27 13:12:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-02-27 13:12:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 13:12:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 13:12:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 13:12:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 13:12:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 13:12:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 13:12:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 13:12:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 13:12:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 13:12:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 13:12:55 [DEBUG   ] Finished updating board flags in 1.975 seconds
2014-02-27 13:13:00 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-02-27 13:13:20 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-02-27 13:13:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-02-27 13:13:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 13:13:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 13:13:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 13:13:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 13:13:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 13:13:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 13:13:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 13:13:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 13:13:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 13:13:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 13:13:55 [DEBUG   ] Finished updating board flags in 1.820 seconds
2014-02-27 13:14:01 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-27 13:14:21 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-02-27 13:14:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 13:14:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 13:14:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 13:14:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 13:14:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 13:14:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 13:14:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 13:14:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 13:14:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 13:14:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 13:14:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 13:14:55 [DEBUG   ] Finished updating board flags in 1.794 seconds
2014-02-27 13:15:01 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 13:15:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 13:15:41 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-02-27 13:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 13:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 13:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 13:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 13:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 13:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 13:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 13:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 13:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 13:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 13:15:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-02-27 13:15:55 [DEBUG   ] Finished updating board flags in 1.638 seconds
2014-02-27 13:16:01 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 13:16:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 13:16:41 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-02-27 13:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 13:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 13:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 13:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 13:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 13:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 13:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 13:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 13:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 13:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 13:16:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-02-27 13:16:55 [DEBUG   ] Finished updating board flags in 1.572 seconds
2014-02-27 13:17:01 [DEBUG   ] Finished updating ant stats in 0.670 seconds
2014-02-27 13:17:21 [DEBUG   ] Finished updating ant stats in 0.530 seconds
2014-02-27 13:17:35 [DEBUG   ] Got command RPT from MCS: ref #290713
2014-02-27 13:17:35 [DEBUG   ] summary = NORMAL
2014-02-27 13:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290713  14 56715 47855790 A NORMALNORMAL'
2014-02-27 13:17:35 [DEBUG   ] Got command RPT from MCS: ref #290714
2014-02-27 13:17:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 13:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290714  48 56715 47855790 A NORMALSystem calibrated and operating normally'
2014-02-27 13:17:41 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-02-27 13:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 13:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 13:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 13:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 13:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 13:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 13:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 13:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 13:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 13:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 13:17:55 [DEBUG   ] Finished updating board flags in 1.402 seconds
2014-02-27 13:18:02 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-02-27 13:18:22 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2014-02-27 13:18:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-02-27 13:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 13:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 13:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 13:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 13:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 13:18:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 13:18:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 13:18:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 13:18:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 13:18:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 13:18:55 [DEBUG   ] Finished updating board flags in 1.414 seconds
2014-02-27 13:19:02 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-02-27 13:19:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-02-27 13:19:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-02-27 13:19:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 13:19:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 13:19:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 13:19:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 13:19:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 13:19:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 13:19:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 13:19:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 13:19:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 13:19:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 13:19:55 [DEBUG   ] Finished updating board flags in 1.392 seconds
2014-02-27 13:20:02 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-02-27 13:20:22 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 13:20:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 13:20:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 13:20:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 13:20:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 13:20:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 13:20:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 13:20:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 13:20:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 13:20:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 13:20:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 13:20:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 13:20:55 [DEBUG   ] Finished updating board flags in 1.349 seconds
2014-02-27 13:21:02 [DEBUG   ] Finished updating ant stats in 0.813 seconds
2014-02-27 13:21:22 [DEBUG   ] Finished updating ant stats in 0.792 seconds
2014-02-27 13:21:42 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-02-27 13:21:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 13:21:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 13:21:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 13:21:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 13:21:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 13:21:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 13:21:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 13:21:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 13:21:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 13:21:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 13:21:56 [DEBUG   ] Finished updating board flags in 2.061 seconds
2014-02-27 13:22:03 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-27 13:22:23 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-02-27 13:22:35 [DEBUG   ] Got command RPT from MCS: ref #290730
2014-02-27 13:22:35 [DEBUG   ] summary = NORMAL
2014-02-27 13:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290730  14 56715 48155793 A NORMALNORMAL'
2014-02-27 13:22:35 [DEBUG   ] Got command RPT from MCS: ref #290731
2014-02-27 13:22:35 [DEBUG   ] info = System calibrated and operating normally
2014-02-27 13:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   290731  48 56715 48155794 A NORMALSystem calibrated and operating normally'
2014-02-27 13:22:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-02-27 13:22:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 13:22:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 13:22:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 13:22:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 13:22:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 13:22:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 13:22:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 13:22:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 13:22:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 13:22:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 13:22:56 [DEBUG   ] Finished updating board flags in 2.010 seconds
2014-02-27 13:23:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-02-27 13:23:23 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-02-27 13:23:43 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-02-27 13:23:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 13:23:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 13:23:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 13:23:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 13:23:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 13:23:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-02-27 13:23:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 13:23:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 13:23:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 13:23:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 13:23:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 13:23:56 [DEBUG   ] Finished updating board flags in 2.015 seconds
2014-02-27 13:24:03 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-02-27 13:24:23 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-02-27 13:24:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-02-27 13:24:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-02-27 13:24:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-02-27 13:24:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-02-27 13:24:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-02-27 13:24:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-02-27 13:24:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-02-27 13:24:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-02-27 13:24:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-02-27 13:24:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-02-27 13:24:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-02-27 13:24:56 [DEBUG   ] Finished updating board flags in 1.976 seconds
