2013-06-28 12:25:12 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 12:25:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 12:25:48 [DEBUG   ] Finished updating board flags in 2.020 seconds
2013-06-28 12:25:52 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-28 12:26:12 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-06-28 12:26:32 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-06-28 12:26:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 12:26:48 [DEBUG   ] Finished updating board flags in 2.009 seconds
2013-06-28 12:26:53 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2013-06-28 12:27:13 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-28 12:27:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 12:27:48 [DEBUG   ] Finished updating board flags in 1.979 seconds
2013-06-28 12:27:53 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-28 12:28:13 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 12:28:33 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-28 12:28:39 [DEBUG   ] Got command RPT from MCS: ref #47256
2013-06-28 12:28:39 [DEBUG   ] summary = NORMAL
2013-06-28 12:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47256  14 56471 44919277 A NORMALNORMAL'
2013-06-28 12:28:39 [DEBUG   ] Got command RPT from MCS: ref #47257
2013-06-28 12:28:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-28 12:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47257  48 56471 44919278 A NORMALSystem calibrated and operating normally'
2013-06-28 12:28:48 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 12:28:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 12:28:48 [DEBUG   ] Finished updating board flags in 1.818 seconds
2013-06-28 12:28:53 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-06-28 12:29:13 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-06-28 12:29:33 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-06-28 12:29:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 12:29:48 [DEBUG   ] Finished updating board flags in 1.788 seconds
2013-06-28 12:29:54 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-28 12:30:00 [DEBUG   ] Got command TBN from MCS: ref #47273
2013-06-28 12:30:00 [DEBUG   ] spawn_process: at 2013-06-28 12:30:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '1', '1372422601']
2013-06-28 12:30:00 [DEBUG   ] spawn_process: at 2013-06-28 12:30:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '2', '1372422601']
2013-06-28 12:30:00 [DEBUG   ] tbn = exited with status True, code 0x00
2013-06-28 12:30:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN    47273   8 56471 45000174 A NORMAL'
2013-06-28 12:30:00 [DEBUG   ] spawn_process: at 2013-06-28 12:30:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '3', '1372422601']
2013-06-28 12:30:00 [DEBUG   ] spawn_process: at 2013-06-28 12:30:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '4', '1372422601']
2013-06-28 12:30:00 [DEBUG   ] spawn_process: at 2013-06-28 12:30:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '5', '1372422601']
2013-06-28 12:30:00 [DEBUG   ] spawn_process: at 2013-06-28 12:30:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '6', '1372422601']
2013-06-28 12:30:00 [DEBUG   ] spawn_process: at 2013-06-28 12:30:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '7', '1372422601']
2013-06-28 12:30:00 [DEBUG   ] spawn_process: at 2013-06-28 12:30:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '8', '1372422601']
2013-06-28 12:30:00 [DEBUG   ] spawn_process: at 2013-06-28 12:30:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '9', '1372422601']
2013-06-28 12:30:00 [DEBUG   ] spawn_process: at 2013-06-28 12:30:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '10', '1372422601']
2013-06-28 12:30:00 [DEBUG   ] spawn_process: at 2013-06-28 12:30:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '11', '1372422601']
2013-06-28 12:30:00 [DEBUG   ] spawn_process: at 2013-06-28 12:30:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '12', '1372422601']
2013-06-28 12:30:00 [DEBUG   ] spawn_process: at 2013-06-28 12:30:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '13', '1372422601']
2013-06-28 12:30:00 [DEBUG   ] spawn_process: at 2013-06-28 12:30:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '14', '1372422601']
2013-06-28 12:30:00 [DEBUG   ] spawn_process: at 2013-06-28 12:30:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '15', '1372422601']
2013-06-28 12:30:00 [DEBUG   ] spawn_process: at 2013-06-28 12:30:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '16', '1372422601']
2013-06-28 12:30:00 [DEBUG   ] spawn_process: at 2013-06-28 12:30:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '17', '1372422601']
2013-06-28 12:30:00 [DEBUG   ] spawn_process: at 2013-06-28 12:30:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '18', '1372422601']
2013-06-28 12:30:00 [DEBUG   ] spawn_process: at 2013-06-28 12:30:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '19', '1372422601']
2013-06-28 12:30:00 [DEBUG   ] spawn_process: at 2013-06-28 12:30:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '20', '1372422601']
2013-06-28 12:30:00 [DEBUG   ] spawn_process: at 2013-06-28 12:30:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '21', '1372422601']
2013-06-28 12:30:00 [DEBUG   ] spawn_process: at 2013-06-28 12:30:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '22', '1372422601']
2013-06-28 12:30:00 [DEBUG   ] spawn_process: at 2013-06-28 12:30:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '23', '1372422601']
2013-06-28 12:30:00 [DEBUG   ] spawn_process: at 2013-06-28 12:30:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '24', '1372422601']
2013-06-28 12:30:00 [DEBUG   ] spawn_process: at 2013-06-28 12:30:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '25', '1372422601']
2013-06-28 12:30:00 [DEBUG   ] spawn_process: at 2013-06-28 12:30:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '26', '1372422601']
2013-06-28 12:30:00 [INFO    ] Finished spawning TBN in 0.049 s
2013-06-28 12:30:14 [DEBUG   ] Finished updating ant stats in 1.069 seconds
2013-06-28 12:30:34 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-28 12:30:48 [DEBUG   ] Finished updating board flags in 1.843 seconds
2013-06-28 12:30:54 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2013-06-28 12:31:14 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-28 12:31:34 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2013-06-28 12:31:48 [DEBUG   ] Finished updating board flags in 1.782 seconds
2013-06-28 12:31:54 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2013-06-28 12:32:14 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-06-28 12:32:35 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-28 12:32:48 [DEBUG   ] Finished updating board flags in 1.616 seconds
2013-06-28 12:32:55 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-28 12:33:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-28 12:33:35 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-28 12:33:39 [DEBUG   ] Got command RPT from MCS: ref #47274
2013-06-28 12:33:39 [DEBUG   ] summary = NORMAL
2013-06-28 12:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47274  14 56471 45219273 A NORMALNORMAL'
2013-06-28 12:33:39 [DEBUG   ] Got command RPT from MCS: ref #47275
2013-06-28 12:33:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-28 12:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47275  48 56471 45219285 A NORMALSystem calibrated and operating normally'
2013-06-28 12:33:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-28 12:33:48 [DEBUG   ] Finished updating board flags in 1.591 seconds
2013-06-28 12:33:55 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2013-06-28 12:34:15 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-28 12:34:35 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-28 12:34:48 [DEBUG   ] Finished updating board flags in 1.407 seconds
2013-06-28 12:34:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 12:35:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 12:35:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 12:35:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-28 12:35:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 12:35:48 [DEBUG   ] Finished updating board flags in 1.557 seconds
2013-06-28 12:35:55 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-28 12:36:15 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-28 12:36:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 12:36:49 [DEBUG   ] Finished updating board flags in 2.354 seconds
2013-06-28 12:36:55 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-28 12:37:15 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-28 12:37:35 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-06-28 12:37:49 [DEBUG   ] Finished updating board flags in 2.081 seconds
2013-06-28 12:37:56 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-28 12:38:16 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 12:38:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 12:38:39 [DEBUG   ] Got command RPT from MCS: ref #47291
2013-06-28 12:38:39 [DEBUG   ] summary = NORMAL
2013-06-28 12:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47291  14 56471 45519277 A NORMALNORMAL'
2013-06-28 12:38:39 [DEBUG   ] Got command RPT from MCS: ref #47292
2013-06-28 12:38:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-28 12:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47292  48 56471 45519278 A NORMALSystem calibrated and operating normally'
2013-06-28 12:38:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-28 12:38:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 12:38:49 [DEBUG   ] Finished updating board flags in 2.016 seconds
2013-06-28 12:38:56 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-28 12:39:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 12:39:36 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-28 12:39:49 [DEBUG   ] Finished updating board flags in 2.004 seconds
2013-06-28 12:39:56 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-28 12:40:16 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2013-06-28 12:40:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 12:40:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-28 12:40:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 12:40:49 [DEBUG   ] Finished updating board flags in 1.986 seconds
2013-06-28 12:40:56 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-28 12:41:16 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-28 12:41:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 12:41:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-28 12:41:49 [DEBUG   ] Finished updating board flags in 1.811 seconds
2013-06-28 12:41:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 12:42:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-28 12:42:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 12:42:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-28 12:42:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 12:42:49 [DEBUG   ] Finished updating board flags in 1.809 seconds
2013-06-28 12:42:56 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-28 12:43:16 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-28 12:43:36 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-28 12:43:39 [DEBUG   ] Got command RPT from MCS: ref #47308
2013-06-28 12:43:39 [DEBUG   ] summary = NORMAL
2013-06-28 12:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47308  14 56471 45819285 A NORMALNORMAL'
2013-06-28 12:43:39 [DEBUG   ] Got command RPT from MCS: ref #47309
2013-06-28 12:43:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-28 12:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47309  48 56471 45819286 A NORMALSystem calibrated and operating normally'
2013-06-28 12:43:49 [DEBUG   ] Finished updating board flags in 1.794 seconds
2013-06-28 12:43:57 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2013-06-28 12:44:17 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-28 12:44:37 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-28 12:44:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-28 12:44:49 [DEBUG   ] Finished updating board flags in 1.622 seconds
2013-06-28 12:44:57 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-28 12:45:17 [DEBUG   ] Finished updating ant stats in 1.185 seconds
2013-06-28 12:45:37 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-28 12:45:49 [DEBUG   ] Finished updating board flags in 1.572 seconds
2013-06-28 12:45:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 12:46:17 [DEBUG   ] Finished updating ant stats in 0.781 seconds
2013-06-28 12:46:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 12:46:49 [DEBUG   ] Finished updating board flags in 1.416 seconds
2013-06-28 12:46:57 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-28 12:47:18 [DEBUG   ] Finished updating ant stats in 1.389 seconds
2013-06-28 12:47:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 12:47:49 [DEBUG   ] Finished updating board flags in 1.393 seconds
2013-06-28 12:47:58 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-28 12:48:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 12:48:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 12:48:39 [DEBUG   ] Got command RPT from MCS: ref #47325
2013-06-28 12:48:39 [DEBUG   ] summary = NORMAL
2013-06-28 12:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47325  14 56471 46119281 A NORMALNORMAL'
2013-06-28 12:48:39 [DEBUG   ] Got command RPT from MCS: ref #47326
2013-06-28 12:48:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-28 12:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47326  48 56471 46119282 A NORMALSystem calibrated and operating normally'
2013-06-28 12:48:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2013-06-28 12:48:50 [DEBUG   ] Finished updating board flags in 2.208 seconds
2013-06-28 12:48:58 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-28 12:49:18 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-28 12:49:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 12:49:50 [DEBUG   ] Finished updating board flags in 2.211 seconds
2013-06-28 12:49:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 12:50:18 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-28 12:50:38 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-28 12:50:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2013-06-28 12:50:50 [DEBUG   ] Finished updating board flags in 2.206 seconds
2013-06-28 12:50:58 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-28 12:51:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 12:51:38 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-28 12:51:50 [DEBUG   ] Finished updating board flags in 2.187 seconds
2013-06-28 12:51:58 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2013-06-28 12:52:19 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-28 12:52:39 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-28 12:52:50 [DEBUG   ] Finished updating board flags in 2.008 seconds
2013-06-28 12:52:59 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-28 12:53:19 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-28 12:53:39 [DEBUG   ] Got command RPT from MCS: ref #47342
2013-06-28 12:53:39 [DEBUG   ] summary = NORMAL
2013-06-28 12:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47342  14 56471 46419281 A NORMALNORMAL'
2013-06-28 12:53:39 [DEBUG   ] Got command RPT from MCS: ref #47343
2013-06-28 12:53:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-28 12:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47343  48 56471 46419282 A NORMALSystem calibrated and operating normally'
2013-06-28 12:53:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 12:53:50 [DEBUG   ] Finished updating board flags in 2.010 seconds
2013-06-28 12:53:59 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-28 12:54:19 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-28 12:54:39 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-28 12:54:50 [DEBUG   ] Finished updating board flags in 1.989 seconds
2013-06-28 12:54:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 12:55:19 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-28 12:55:39 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-28 12:55:50 [DEBUG   ] Finished updating board flags in 1.817 seconds
2013-06-28 12:56:00 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2013-06-28 12:56:19 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2013-06-28 12:56:40 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-28 12:56:50 [DEBUG   ] Finished updating board flags in 1.786 seconds
2013-06-28 12:57:00 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-28 12:57:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 12:57:40 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-28 12:57:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-28 12:57:50 [DEBUG   ] Finished updating board flags in 1.611 seconds
2013-06-28 12:58:00 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-28 12:58:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 12:58:39 [DEBUG   ] Got command RPT from MCS: ref #47359
2013-06-28 12:58:39 [DEBUG   ] summary = NORMAL
2013-06-28 12:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47359  14 56471 46719289 A NORMALNORMAL'
2013-06-28 12:58:39 [DEBUG   ] Got command RPT from MCS: ref #47360
2013-06-28 12:58:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-28 12:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47360  48 56471 46719290 A NORMALSystem calibrated and operating normally'
2013-06-28 12:58:40 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2013-06-28 12:58:50 [DEBUG   ] Finished updating board flags in 1.583 seconds
2013-06-28 12:59:00 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-28 12:59:20 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-28 12:59:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 12:59:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-28 12:59:50 [DEBUG   ] Finished updating board flags in 1.423 seconds
2013-06-28 13:00:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 13:00:20 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-28 13:00:40 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-28 13:00:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 13:00:50 [DEBUG   ] Finished updating board flags in 1.394 seconds
2013-06-28 13:01:00 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-28 13:01:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 13:01:40 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-28 13:01:51 [DEBUG   ] Finished updating board flags in 2.212 seconds
2013-06-28 13:02:01 [DEBUG   ] Finished updating ant stats in 1.391 seconds
2013-06-28 13:02:21 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-28 13:02:41 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-28 13:02:51 [DEBUG   ] Finished updating board flags in 2.197 seconds
2013-06-28 13:03:01 [DEBUG   ] Finished updating ant stats in 1.007 seconds
2013-06-28 13:03:21 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 13:03:39 [DEBUG   ] Got command RPT from MCS: ref #47376
2013-06-28 13:03:39 [DEBUG   ] summary = NORMAL
2013-06-28 13:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47376  14 56471 47019285 A NORMALNORMAL'
2013-06-28 13:03:39 [DEBUG   ] Got command RPT from MCS: ref #47377
2013-06-28 13:03:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-28 13:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47377  48 56471 47019286 A NORMALSystem calibrated and operating normally'
2013-06-28 13:03:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 13:03:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-28 13:03:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 13:03:51 [DEBUG   ] Finished updating board flags in 2.004 seconds
2013-06-28 13:04:01 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 13:04:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-28 13:04:41 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-28 13:04:51 [DEBUG   ] Finished updating board flags in 2.010 seconds
2013-06-28 13:05:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 13:05:21 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2013-06-28 13:05:41 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-28 13:05:51 [DEBUG   ] Finished updating board flags in 1.987 seconds
2013-06-28 13:06:02 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-28 13:06:22 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-28 13:06:42 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-28 13:06:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 13:06:51 [DEBUG   ] Finished updating board flags in 1.813 seconds
2013-06-28 13:07:02 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-28 13:07:22 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-28 13:07:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 13:07:51 [DEBUG   ] Finished updating board flags in 1.789 seconds
2013-06-28 13:08:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 13:08:22 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2013-06-28 13:08:39 [DEBUG   ] Got command RPT from MCS: ref #47393
2013-06-28 13:08:39 [DEBUG   ] summary = NORMAL
2013-06-28 13:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47393  14 56471 47319285 A NORMALNORMAL'
2013-06-28 13:08:39 [DEBUG   ] Got command RPT from MCS: ref #47394
2013-06-28 13:08:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-28 13:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47394  48 56471 47319286 A NORMALSystem calibrated and operating normally'
2013-06-28 13:08:42 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-28 13:08:51 [DEBUG   ] Finished updating board flags in 1.623 seconds
2013-06-28 13:09:03 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-28 13:09:23 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-06-28 13:09:43 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-28 13:09:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 13:09:51 [DEBUG   ] Finished updating board flags in 1.587 seconds
2013-06-28 13:10:03 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-28 13:10:23 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-28 13:10:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 13:10:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 13:10:51 [DEBUG   ] Finished updating board flags in 1.409 seconds
2013-06-28 13:11:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 13:11:23 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-28 13:11:43 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-28 13:11:51 [DEBUG   ] Finished updating board flags in 1.404 seconds
2013-06-28 13:12:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 13:12:23 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-28 13:12:43 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-28 13:12:51 [DEBUG   ] Finished updating board flags in 1.405 seconds
2013-06-28 13:13:04 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2013-06-28 13:13:24 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-28 13:13:39 [DEBUG   ] Got command RPT from MCS: ref #47410
2013-06-28 13:13:39 [DEBUG   ] summary = NORMAL
2013-06-28 13:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47410  14 56471 47619289 A NORMALNORMAL'
2013-06-28 13:13:39 [DEBUG   ] Got command RPT from MCS: ref #47411
2013-06-28 13:13:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-28 13:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47411  48 56471 47619290 A NORMALSystem calibrated and operating normally'
2013-06-28 13:13:44 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-28 13:13:51 [DEBUG   ] Finished updating board flags in 1.383 seconds
2013-06-28 13:14:04 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-28 13:14:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 13:14:44 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-28 13:14:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-28 13:14:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 13:14:52 [DEBUG   ] Finished updating board flags in 2.214 seconds
2013-06-28 13:15:04 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-28 13:15:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 13:15:44 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-28 13:15:52 [DEBUG   ] Finished updating board flags in 2.211 seconds
2013-06-28 13:16:04 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-28 13:16:24 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-28 13:16:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 13:16:52 [DEBUG   ] Finished updating board flags in 2.184 seconds
2013-06-28 13:17:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 13:17:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-28 13:17:44 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-28 13:17:52 [DEBUG   ] Finished updating board flags in 2.015 seconds
2013-06-28 13:18:05 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-28 13:18:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 13:18:39 [DEBUG   ] Got command RPT from MCS: ref #47427
2013-06-28 13:18:39 [DEBUG   ] summary = NORMAL
2013-06-28 13:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47427  14 56471 47919285 A NORMALNORMAL'
2013-06-28 13:18:39 [DEBUG   ] Got command RPT from MCS: ref #47428
2013-06-28 13:18:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-28 13:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47428  48 56471 47919286 A NORMALSystem calibrated and operating normally'
2013-06-28 13:18:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 196000019
2013-06-28 13:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 196000019
2013-06-28 13:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 196000019
2013-06-28 13:18:52 [DEBUG   ] Finished updating board flags in 2.005 seconds
2013-06-28 13:19:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 13:19:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 13:19:45 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-28 13:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-28 13:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-28 13:19:52 [DEBUG   ] Finished updating board flags in 2.028 seconds
2013-06-28 13:20:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 13:20:25 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-28 13:20:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-28 13:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:20:52 [DEBUG   ] Finished updating board flags in 1.960 seconds
2013-06-28 13:21:05 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2013-06-28 13:21:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 13:21:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 13:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:21:52 [DEBUG   ] Finished updating board flags in 1.814 seconds
2013-06-28 13:22:05 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2013-06-28 13:22:25 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-28 13:22:46 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-28 13:22:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:22:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:22:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:22:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:22:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:22:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:22:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:22:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:22:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:22:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:22:52 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 13:22:52 [DEBUG   ] Finished updating board flags in 1.793 seconds
2013-06-28 13:23:06 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-28 13:23:26 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-28 13:23:39 [DEBUG   ] Got command RPT from MCS: ref #47444
2013-06-28 13:23:39 [DEBUG   ] summary = NORMAL
2013-06-28 13:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47444  14 56471 48219293 A NORMALNORMAL'
2013-06-28 13:23:39 [DEBUG   ] Got command RPT from MCS: ref #47445
2013-06-28 13:23:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-28 13:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47445  48 56471 48219294 A NORMALSystem calibrated and operating normally'
2013-06-28 13:23:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 13:23:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:23:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:23:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:23:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:23:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:23:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:23:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:23:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:23:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:23:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:23:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 13:23:52 [DEBUG   ] Finished updating board flags in 1.601 seconds
2013-06-28 13:24:06 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-28 13:24:26 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-28 13:24:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 13:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:24:52 [DEBUG   ] Finished updating board flags in 1.608 seconds
2013-06-28 13:25:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 13:25:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 13:25:46 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-28 13:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:25:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 13:25:52 [DEBUG   ] Finished updating board flags in 1.657 seconds
2013-06-28 13:26:06 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-28 13:26:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 13:26:46 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 13:26:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:26:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:26:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:26:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:26:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:26:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 13:26:52 [DEBUG   ] Finished updating board flags in 1.606 seconds
2013-06-28 13:27:06 [DEBUG   ] Finished updating ant stats in 0.588 seconds
2013-06-28 13:27:27 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-28 13:27:47 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-06-28 13:27:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:27:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:27:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:27:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:27:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:27:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:27:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:27:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:27:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:27:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:27:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 13:27:52 [DEBUG   ] Finished updating board flags in 1.525 seconds
2013-06-28 13:28:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-28 13:28:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-28 13:28:39 [DEBUG   ] Got command RPT from MCS: ref #47461
2013-06-28 13:28:39 [DEBUG   ] summary = NORMAL
2013-06-28 13:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47461  14 56471 48519289 A NORMALNORMAL'
2013-06-28 13:28:39 [DEBUG   ] Got command RPT from MCS: ref #47462
2013-06-28 13:28:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-28 13:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47462  48 56471 48519290 A NORMALSystem calibrated and operating normally'
2013-06-28 13:28:47 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-28 13:28:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:28:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:28:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:28:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:28:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:28:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:28:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:28:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:28:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:28:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:28:52 [DEBUG   ] Finished updating board flags in 1.410 seconds
2013-06-28 13:29:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 13:29:27 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-28 13:29:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 13:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:29:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:29:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:29:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:29:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:29:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:29:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 13:29:52 [DEBUG   ] Finished updating board flags in 1.411 seconds
2013-06-28 13:30:07 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-28 13:30:27 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-28 13:30:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-28 13:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:30:52 [DEBUG   ] Finished updating board flags in 1.386 seconds
2013-06-28 13:31:07 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-28 13:31:28 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-28 13:31:48 [DEBUG   ] Finished updating ant stats in 1.183 seconds
2013-06-28 13:31:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:31:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:31:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:31:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:31:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:31:53 [DEBUG   ] Finished updating board flags in 2.218 seconds
2013-06-28 13:32:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 13:32:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 13:32:48 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-28 13:32:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:32:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:32:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:32:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:32:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:32:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:32:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:32:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:32:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:32:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:32:53 [DEBUG   ] Finished updating board flags in 2.185 seconds
2013-06-28 13:33:08 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2013-06-28 13:33:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 13:33:39 [DEBUG   ] Got command RPT from MCS: ref #47478
2013-06-28 13:33:39 [DEBUG   ] summary = NORMAL
2013-06-28 13:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47478  14 56471 48819289 A NORMALNORMAL'
2013-06-28 13:33:39 [DEBUG   ] Got command RPT from MCS: ref #47479
2013-06-28 13:33:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-28 13:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47479  48 56471 48819290 A NORMALSystem calibrated and operating normally'
2013-06-28 13:33:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 13:33:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:33:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:33:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:33:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:33:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:33:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:33:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:33:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:33:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:33:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:33:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 13:33:53 [DEBUG   ] Finished updating board flags in 2.023 seconds
2013-06-28 13:34:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 13:34:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-28 13:34:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 13:34:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:34:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:34:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:34:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:34:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:34:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:34:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:34:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:34:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:34:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:34:53 [DEBUG   ] Finished updating board flags in 1.986 seconds
2013-06-28 13:35:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 13:35:28 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-28 13:35:48 [DEBUG   ] Finished updating ant stats in 0.527 seconds
2013-06-28 13:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:35:53 [DEBUG   ] Finished updating board flags in 1.811 seconds
2013-06-28 13:36:09 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2013-06-28 13:36:28 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-28 13:36:49 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-28 13:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:36:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-28 13:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:36:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 13:36:53 [DEBUG   ] Finished updating board flags in 1.795 seconds
2013-06-28 13:37:09 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-28 13:37:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 13:37:49 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-28 13:37:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:37:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:37:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:37:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:37:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:37:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:37:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:37:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:37:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:37:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:37:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-28 13:37:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 13:37:53 [DEBUG   ] Finished updating board flags in 1.611 seconds
2013-06-28 13:38:09 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-28 13:38:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 13:38:39 [DEBUG   ] Got command RPT from MCS: ref #47495
2013-06-28 13:38:39 [DEBUG   ] summary = NORMAL
2013-06-28 13:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47495  14 56471 49119289 A NORMALNORMAL'
2013-06-28 13:38:39 [DEBUG   ] Got command RPT from MCS: ref #47496
2013-06-28 13:38:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-28 13:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47496  48 56471 49119290 A NORMALSystem calibrated and operating normally'
2013-06-28 13:38:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 13:38:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:38:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:38:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:38:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:38:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:38:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:38:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:38:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:38:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:38:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:38:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 13:38:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-28 13:38:53 [DEBUG   ] Finished updating board flags in 1.584 seconds
2013-06-28 13:39:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 13:39:29 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-28 13:39:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 13:39:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:39:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:39:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:39:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:39:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:39:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:39:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:39:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:39:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:39:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:39:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 13:39:53 [DEBUG   ] Finished updating board flags in 1.418 seconds
2013-06-28 13:40:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 13:40:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-28 13:40:49 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-28 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:40:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 13:40:53 [DEBUG   ] Finished updating board flags in 1.406 seconds
2013-06-28 13:41:09 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-28 13:41:30 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-28 13:41:50 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-28 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:41:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 13:41:53 [DEBUG   ] Finished updating board flags in 1.406 seconds
2013-06-28 13:42:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 13:42:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 13:42:50 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-28 13:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:42:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:42:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:42:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:42:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:42:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:42:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 13:42:53 [DEBUG   ] Finished updating board flags in 1.389 seconds
2013-06-28 13:43:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 13:43:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 13:43:39 [DEBUG   ] Got command RPT from MCS: ref #47512
2013-06-28 13:43:39 [DEBUG   ] summary = NORMAL
2013-06-28 13:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47512  14 56471 49419297 A NORMALNORMAL'
2013-06-28 13:43:39 [DEBUG   ] Got command RPT from MCS: ref #47513
2013-06-28 13:43:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-28 13:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47513  48 56471 49419298 A NORMALSystem calibrated and operating normally'
2013-06-28 13:43:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 13:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:43:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 13:43:54 [DEBUG   ] Finished updating board flags in 2.212 seconds
2013-06-28 13:44:10 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-28 13:44:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 13:44:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 13:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:44:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 13:44:54 [DEBUG   ] Finished updating board flags in 2.188 seconds
2013-06-28 13:45:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 13:45:30 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-28 13:45:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 13:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:45:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:45:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:45:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:45:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:45:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:45:54 [DEBUG   ] Finished updating board flags in 2.019 seconds
2013-06-28 13:46:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 13:46:30 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-28 13:46:50 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-28 13:46:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:46:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:46:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:46:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:46:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:46:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:46:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:46:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:46:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:46:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:46:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 13:46:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-28 13:46:54 [DEBUG   ] Finished updating board flags in 2.012 seconds
2013-06-28 13:47:10 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-28 13:47:31 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-28 13:47:50 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-28 13:47:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:47:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:47:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:47:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:47:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:47:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:47:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:47:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:47:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:47:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:47:54 [DEBUG   ] Finished updating board flags in 2.008 seconds
2013-06-28 13:48:11 [DEBUG   ] Finished updating ant stats in 1.390 seconds
2013-06-28 13:48:31 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-28 13:48:39 [DEBUG   ] Got command RPT from MCS: ref #47529
2013-06-28 13:48:39 [DEBUG   ] summary = NORMAL
2013-06-28 13:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47529  14 56471 49719297 A NORMALNORMAL'
2013-06-28 13:48:39 [DEBUG   ] Got command RPT from MCS: ref #47530
2013-06-28 13:48:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-28 13:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47530  48 56471 49719298 A NORMALSystem calibrated and operating normally'
2013-06-28 13:48:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 13:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:48:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2013-06-28 13:48:54 [CRITICAL] MGT underflow detected on beam(s) 1
2013-06-28 13:48:54 [DEBUG   ] Finished updating board flags in 1.973 seconds
2013-06-28 13:49:11 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-28 13:49:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 13:49:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 13:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:49:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 13:49:54 [DEBUG   ] Finished updating board flags in 1.816 seconds
2013-06-28 13:50:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 13:50:31 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-28 13:50:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 13:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:50:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-28 13:50:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-28 13:50:54 [DEBUG   ] Finished updating board flags in 1.794 seconds
2013-06-28 13:51:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 13:51:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 13:51:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 13:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:51:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 13:51:54 [DEBUG   ] Finished updating board flags in 1.632 seconds
2013-06-28 13:52:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 13:52:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 13:52:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 13:52:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:52:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:52:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:52:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:52:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:52:54 [DEBUG   ] Finished updating board flags in 1.564 seconds
2013-06-28 13:53:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 13:53:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 13:53:39 [DEBUG   ] Got command RPT from MCS: ref #47546
2013-06-28 13:53:39 [DEBUG   ] summary = ERROR
2013-06-28 13:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47546  13 56471 50019297 A  ERRORERROR'
2013-06-28 13:53:39 [DEBUG   ] Got command RPT from MCS: ref #47547
2013-06-28 13:53:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 13:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47547  77 56471 50019298 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 13:53:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 13:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:53:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 13:53:54 [DEBUG   ] Finished updating board flags in 1.487 seconds
2013-06-28 13:54:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 13:54:31 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-28 13:54:51 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 13:54:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:54:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:54:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:54:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:54:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:54:55 [DEBUG   ] Finished updating board flags in 2.372 seconds
2013-06-28 13:55:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 13:55:31 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 13:55:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 13:55:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:55:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:55:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:55:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:55:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:55:55 [DEBUG   ] Finished updating board flags in 2.211 seconds
2013-06-28 13:56:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 13:56:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 13:56:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 13:56:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:56:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:56:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:56:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:56:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:56:55 [DEBUG   ] Finished updating board flags in 2.224 seconds
2013-06-28 13:57:11 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-28 13:57:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-28 13:57:52 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-28 13:57:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:57:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:57:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:57:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:57:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:57:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 13:57:55 [DEBUG   ] Finished updating board flags in 2.110 seconds
2013-06-28 13:58:12 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-28 13:58:32 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 13:58:39 [DEBUG   ] Got command RPT from MCS: ref #47563
2013-06-28 13:58:39 [DEBUG   ] summary = ERROR
2013-06-28 13:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47563  13 56471 50319293 A  ERRORERROR'
2013-06-28 13:58:39 [DEBUG   ] Got command RPT from MCS: ref #47564
2013-06-28 13:58:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 13:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47564  77 56471 50319294 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 13:58:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 13:58:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:58:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:58:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:58:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:58:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:58:55 [DEBUG   ] Finished updating board flags in 2.002 seconds
2013-06-28 13:59:12 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-28 13:59:32 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-28 13:59:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 13:59:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 13:59:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 13:59:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 13:59:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 13:59:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 13:59:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 13:59:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 13:59:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 13:59:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 13:59:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 13:59:55 [DEBUG   ] Finished updating board flags in 1.992 seconds
2013-06-28 14:00:12 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-28 14:00:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 14:00:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 14:00:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 14:00:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 14:00:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 14:00:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 14:00:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 14:00:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 14:00:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 14:00:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 14:00:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 14:00:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 14:00:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 14:00:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 14:00:55 [DEBUG   ] Finished updating board flags in 1.817 seconds
2013-06-28 14:01:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 14:01:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 14:01:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 14:01:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 14:01:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 14:01:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 14:01:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 14:01:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 14:01:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-28 14:01:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 14:01:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 14:01:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 14:01:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 14:01:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 14:01:55 [DEBUG   ] Finished updating board flags in 1.844 seconds
2013-06-28 14:02:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 14:02:32 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 14:02:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 14:02:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 14:02:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 14:02:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 14:02:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 14:02:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 14:02:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 14:02:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 14:02:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 14:02:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 14:02:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 14:02:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 14:02:55 [DEBUG   ] Finished updating board flags in 1.750 seconds
2013-06-28 14:03:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 14:03:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 14:03:39 [DEBUG   ] Got command RPT from MCS: ref #47580
2013-06-28 14:03:39 [DEBUG   ] summary = ERROR
2013-06-28 14:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47580  13 56471 50619293 A  ERRORERROR'
2013-06-28 14:03:39 [DEBUG   ] Got command RPT from MCS: ref #47581
2013-06-28 14:03:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 14:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47581  77 56471 50619294 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 14:03:52 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 14:03:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 14:03:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 14:03:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 14:03:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 14:03:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 14:03:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 14:03:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 14:03:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 14:03:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 14:03:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 14:03:55 [DEBUG   ] Finished updating board flags in 1.616 seconds
2013-06-28 14:04:12 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 14:04:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 14:04:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 14:04:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 14:04:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 14:04:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 14:04:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 14:04:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 14:04:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 14:04:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 14:04:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 14:04:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 14:04:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 14:04:55 [DEBUG   ] Finished updating board flags in 1.659 seconds
2013-06-28 14:05:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 14:05:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 14:05:52 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 14:05:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-28 14:05:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-28 14:05:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-28 14:05:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-28 14:05:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-28 14:05:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-28 14:05:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-28 14:05:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-28 14:05:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-28 14:05:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-28 14:05:55 [DEBUG   ] Finished updating board flags in 1.620 seconds
2013-06-28 14:06:12 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-28 14:06:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 14:06:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999783
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999783
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999783
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999783
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999783
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 196000019
2013-06-28 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999783
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 196000019
2013-06-28 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 196000019
2013-06-28 14:06:55 [DEBUG   ] Finished updating board flags in 1.516 seconds
2013-06-28 14:07:12 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 14:07:32 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-28 14:07:53 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999921
2013-06-28 14:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999921
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999921
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999921
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999921
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999921
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999921
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-28 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-28 14:07:55 [DEBUG   ] Finished updating board flags in 1.500 seconds
2013-06-28 14:08:13 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-28 14:08:33 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2013-06-28 14:08:39 [DEBUG   ] Got command RPT from MCS: ref #47597
2013-06-28 14:08:39 [DEBUG   ] summary = ERROR
2013-06-28 14:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47597  13 56471 50919293 A  ERRORERROR'
2013-06-28 14:08:39 [DEBUG   ] Got command RPT from MCS: ref #47598
2013-06-28 14:08:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 14:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47598  77 56471 50919294 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 14:08:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-28 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-28 14:08:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-28 14:08:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-28 14:08:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-28 14:08:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-28 14:08:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-28 14:08:56 [DEBUG   ] Finished updating board flags in 2.310 seconds
2013-06-28 14:09:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 14:09:33 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-28 14:09:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 14:09:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-28 14:09:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-28 14:09:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-28 14:09:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-28 14:09:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-28 14:09:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-28 14:09:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-28 14:09:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-28 14:09:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-28 14:09:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-28 14:09:56 [DEBUG   ] Finished updating board flags in 2.197 seconds
2013-06-28 14:10:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 14:10:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 14:10:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-28 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-28 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-28 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-28 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-28 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-28 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-28 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-28 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-28 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-28 14:10:56 [DEBUG   ] Finished updating board flags in 2.028 seconds
2013-06-28 14:11:13 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-28 14:11:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 14:11:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-28 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-28 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-28 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-28 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-28 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-28 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-28 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-28 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-28 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-28 14:11:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 14:11:56 [DEBUG   ] Finished updating board flags in 1.962 seconds
2013-06-28 14:12:13 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-28 14:12:34 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-28 14:12:54 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 14:12:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-28 14:12:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-28 14:12:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-28 14:12:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-28 14:12:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-28 14:12:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-28 14:12:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-28 14:12:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-28 14:12:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-28 14:12:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-28 14:12:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-28 14:12:56 [DEBUG   ] Finished updating board flags in 1.816 seconds
2013-06-28 14:13:14 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-28 14:13:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 14:13:39 [DEBUG   ] Got command RPT from MCS: ref #47614
2013-06-28 14:13:39 [DEBUG   ] summary = ERROR
2013-06-28 14:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47614  13 56471 51219297 A  ERRORERROR'
2013-06-28 14:13:39 [DEBUG   ] Got command RPT from MCS: ref #47615
2013-06-28 14:13:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 14:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47615  77 56471 51219298 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 14:13:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 14:13:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-28 14:13:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-28 14:13:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-28 14:13:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-28 14:13:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-28 14:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-28 14:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-28 14:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-28 14:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-28 14:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-28 14:13:56 [DEBUG   ] Finished updating board flags in 1.792 seconds
2013-06-28 14:14:14 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-28 14:14:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 14:14:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 14:14:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-28 14:14:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-28 14:14:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-28 14:14:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-28 14:14:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-28 14:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-28 14:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-28 14:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-28 14:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-28 14:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-28 14:14:56 [DEBUG   ] Finished updating board flags in 1.615 seconds
2013-06-28 14:15:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 14:15:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 14:15:54 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-28 14:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-28 14:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-28 14:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-28 14:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-28 14:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-28 14:15:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-28 14:15:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-28 14:15:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-28 14:15:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-28 14:15:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-28 14:15:56 [DEBUG   ] Finished updating board flags in 1.614 seconds
2013-06-28 14:16:14 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 14:16:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 14:16:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 14:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-28 14:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-28 14:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-28 14:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-28 14:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-28 14:16:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-28 14:16:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-28 14:16:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-28 14:16:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-28 14:16:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-28 14:16:56 [DEBUG   ] Finished updating board flags in 1.574 seconds
2013-06-28 14:17:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 14:17:34 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 14:17:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 196000019
2013-06-28 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 196000019
2013-06-28 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 196000019
2013-06-28 14:17:56 [DEBUG   ] Finished updating board flags in 1.445 seconds
2013-06-28 14:18:14 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-28 14:18:35 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-28 14:18:39 [DEBUG   ] Got command RPT from MCS: ref #47631
2013-06-28 14:18:39 [DEBUG   ] summary = ERROR
2013-06-28 14:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47631  13 56471 51519297 A  ERRORERROR'
2013-06-28 14:18:39 [DEBUG   ] Got command RPT from MCS: ref #47632
2013-06-28 14:18:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 14:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47632  77 56471 51519298 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 14:18:55 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-28 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-28 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-28 14:18:57 [DEBUG   ] Finished updating board flags in 2.388 seconds
2013-06-28 14:19:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 14:19:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 14:19:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 14:19:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:19:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:19:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:19:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:19:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:19:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:19:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:19:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:19:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:19:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:19:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 14:19:57 [DEBUG   ] Finished updating board flags in 2.166 seconds
2013-06-28 14:20:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 14:20:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 14:20:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 14:20:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:20:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:20:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:20:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:20:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:20:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:20:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:20:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:20:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:20:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:20:57 [DEBUG   ] Finished updating board flags in 2.001 seconds
2013-06-28 14:21:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 14:21:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 14:21:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 14:21:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:21:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:21:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:21:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:21:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:21:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:21:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:21:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:21:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:21:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:21:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2013-06-28 14:21:57 [CRITICAL] MGT underflow detected on beam(s) 1
2013-06-28 14:21:57 [DEBUG   ] Finished updating board flags in 2.100 seconds
2013-06-28 14:22:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 14:22:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 14:22:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 14:22:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:22:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:22:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:22:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:22:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:22:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:22:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:22:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:22:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:22:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:22:57 [DEBUG   ] Finished updating board flags in 1.922 seconds
2013-06-28 14:23:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 14:23:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 14:23:39 [DEBUG   ] Got command RPT from MCS: ref #47648
2013-06-28 14:23:39 [DEBUG   ] summary = ERROR
2013-06-28 14:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47648  13 56471 51819305 A  ERRORERROR'
2013-06-28 14:23:39 [DEBUG   ] Got command RPT from MCS: ref #47649
2013-06-28 14:23:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 14:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47649  77 56471 51819306 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 14:23:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 14:23:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:23:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:23:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:23:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:23:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:23:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:23:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:23:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:23:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:23:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:23:57 [DEBUG   ] Finished updating board flags in 1.815 seconds
2013-06-28 14:24:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 14:24:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 14:24:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 14:24:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:24:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:24:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:24:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:24:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:24:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:24:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:24:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:24:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:24:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:24:57 [DEBUG   ] Finished updating board flags in 1.780 seconds
2013-06-28 14:25:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 14:25:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 14:25:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 14:25:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:25:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:25:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:25:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:25:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:25:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:25:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:25:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:25:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:25:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:25:57 [DEBUG   ] Finished updating board flags in 1.616 seconds
2013-06-28 14:26:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 14:26:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 14:26:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 14:26:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:26:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:26:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:26:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:26:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:26:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:26:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:26:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:26:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:26:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:26:57 [DEBUG   ] Finished updating board flags in 1.659 seconds
2013-06-28 14:27:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-28 14:27:35 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-28 14:27:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 14:27:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:27:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:27:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:27:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:27:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:27:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:27:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:27:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:27:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:27:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:27:57 [DEBUG   ] Finished updating board flags in 1.615 seconds
2013-06-28 14:28:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 14:28:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 14:28:39 [DEBUG   ] Got command RPT from MCS: ref #47665
2013-06-28 14:28:39 [DEBUG   ] summary = ERROR
2013-06-28 14:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47665  13 56471 52119301 A  ERRORERROR'
2013-06-28 14:28:39 [DEBUG   ] Got command RPT from MCS: ref #47666
2013-06-28 14:28:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 14:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47666  77 56471 52119302 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 14:28:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 14:28:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:28:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:28:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:28:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:28:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:28:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:28:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:28:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:28:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:28:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:28:57 [DEBUG   ] Finished updating board flags in 1.518 seconds
2013-06-28 14:29:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 14:29:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 14:29:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 14:29:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:29:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:29:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:29:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:29:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:29:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:29:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:29:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:29:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:29:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:29:57 [DEBUG   ] Finished updating board flags in 1.501 seconds
2013-06-28 14:30:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 14:30:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 14:30:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 14:30:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:30:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:30:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:30:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:30:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:30:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:30:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:30:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:30:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:30:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:30:58 [DEBUG   ] Finished updating board flags in 2.335 seconds
2013-06-28 14:31:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 14:31:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 14:31:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 14:31:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:31:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:31:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:31:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:31:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:31:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:31:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:31:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:31:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:31:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:31:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-28 14:31:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 14:31:58 [DEBUG   ] Finished updating board flags in 2.187 seconds
2013-06-28 14:32:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 14:32:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 14:32:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:32:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-28 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:32:58 [DEBUG   ] Finished updating board flags in 2.086 seconds
2013-06-28 14:33:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 14:33:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 14:33:39 [DEBUG   ] Got command RPT from MCS: ref #47682
2013-06-28 14:33:39 [DEBUG   ] summary = ERROR
2013-06-28 14:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47682  13 56471 52419301 A  ERRORERROR'
2013-06-28 14:33:39 [DEBUG   ] Got command RPT from MCS: ref #47683
2013-06-28 14:33:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 14:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47683  77 56471 52419302 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 14:33:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:33:58 [DEBUG   ] Finished updating board flags in 1.958 seconds
2013-06-28 14:34:15 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-28 14:34:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 14:34:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 14:34:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:34:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:34:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:34:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:34:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:34:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:34:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:34:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:34:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:34:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:34:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-28 14:34:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 14:34:58 [DEBUG   ] Finished updating board flags in 1.760 seconds
2013-06-28 14:35:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 14:35:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 14:35:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 14:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:35:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-28 14:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:35:58 [DEBUG   ] Finished updating board flags in 1.610 seconds
2013-06-28 14:36:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 14:36:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 14:36:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 14:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:36:58 [DEBUG   ] Finished updating board flags in 1.571 seconds
2013-06-28 14:37:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 14:37:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 14:37:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 14:37:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:37:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:37:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:37:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:37:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:37:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:37:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:37:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:37:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:37:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:37:58 [DEBUG   ] Finished updating board flags in 1.501 seconds
2013-06-28 14:38:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 14:38:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 14:38:39 [DEBUG   ] Got command RPT from MCS: ref #47699
2013-06-28 14:38:39 [DEBUG   ] summary = ERROR
2013-06-28 14:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47699  13 56471 52719301 A  ERRORERROR'
2013-06-28 14:38:39 [DEBUG   ] Got command RPT from MCS: ref #47700
2013-06-28 14:38:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 14:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47700  77 56471 52719302 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 14:38:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 14:38:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:38:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:38:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:38:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:38:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:38:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:38:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:38:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:38:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:38:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:38:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 14:38:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 14:38:59 [DEBUG   ] Finished updating board flags in 2.392 seconds
2013-06-28 14:39:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 14:39:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 14:39:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 14:39:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:39:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:39:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:39:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:39:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:39:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:39:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:39:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:39:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:39:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:39:59 [DEBUG   ] Finished updating board flags in 2.245 seconds
2013-06-28 14:40:15 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-28 14:40:36 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-28 14:40:56 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-28 14:40:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:40:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:40:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:40:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:40:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:40:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:40:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:40:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:40:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:40:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:40:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 14:40:59 [DEBUG   ] Finished updating board flags in 2.080 seconds
2013-06-28 14:41:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 14:41:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 14:41:56 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-28 14:41:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:41:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:41:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:41:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:41:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:41:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:41:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:41:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:41:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:41:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:41:59 [DEBUG   ] Finished updating board flags in 2.006 seconds
2013-06-28 14:42:16 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 14:42:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 14:42:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 14:42:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:42:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:42:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:42:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:42:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:42:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:42:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:42:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:42:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:42:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:42:59 [DEBUG   ] Finished updating board flags in 1.984 seconds
2013-06-28 14:43:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 14:43:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 14:43:39 [DEBUG   ] Got command RPT from MCS: ref #47716
2013-06-28 14:43:39 [DEBUG   ] summary = ERROR
2013-06-28 14:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47716  13 56471 53019305 A  ERRORERROR'
2013-06-28 14:43:39 [DEBUG   ] Got command RPT from MCS: ref #47717
2013-06-28 14:43:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 14:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47717  77 56471 53019306 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 14:43:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 14:43:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:43:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:43:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:43:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:43:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:43:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:43:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:43:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:43:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:43:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:43:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 14:43:59 [DEBUG   ] Finished updating board flags in 1.825 seconds
2013-06-28 14:44:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 14:44:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 14:44:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 14:44:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:44:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:44:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:44:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:44:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:44:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:44:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:44:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:44:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:44:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:44:59 [DEBUG   ] Finished updating board flags in 1.785 seconds
2013-06-28 14:45:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 14:45:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 14:45:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 14:45:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:45:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:45:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:45:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:45:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:45:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:45:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:45:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:45:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:45:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:45:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 14:45:59 [DEBUG   ] Finished updating board flags in 1.706 seconds
2013-06-28 14:46:16 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 14:46:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 14:46:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 14:46:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:46:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:46:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:46:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:46:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:46:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:46:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:46:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:46:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:46:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:46:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 14:46:59 [DEBUG   ] Finished updating board flags in 1.516 seconds
2013-06-28 14:47:16 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-28 14:47:36 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 14:47:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 14:47:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:47:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:47:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:47:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:47:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:47:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:47:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:47:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:47:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:47:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:47:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 14:47:59 [DEBUG   ] Finished updating board flags in 1.476 seconds
2013-06-28 14:48:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 14:48:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 14:48:39 [DEBUG   ] Got command RPT from MCS: ref #47733
2013-06-28 14:48:39 [DEBUG   ] summary = ERROR
2013-06-28 14:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47733  13 56471 53319305 A  ERRORERROR'
2013-06-28 14:48:39 [DEBUG   ] Got command RPT from MCS: ref #47734
2013-06-28 14:48:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 14:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47734  77 56471 53319306 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 14:48:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 14:48:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:48:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:48:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:48:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:48:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:49:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:49:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:49:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:49:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:49:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:49:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 14:49:00 [DEBUG   ] Finished updating board flags in 2.354 seconds
2013-06-28 14:49:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 14:49:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 14:49:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 14:49:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:49:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:49:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:49:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:49:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:50:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:50:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:50:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:50:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:50:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:50:00 [DEBUG   ] Finished updating board flags in 2.218 seconds
2013-06-28 14:50:16 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2013-06-28 14:50:36 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2013-06-28 14:50:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-28 14:50:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:50:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:50:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:50:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:50:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:51:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:51:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:51:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:51:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:51:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:51:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 14:51:00 [DEBUG   ] Finished updating board flags in 2.142 seconds
2013-06-28 14:51:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-28 14:51:37 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-28 14:51:57 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-28 14:51:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:51:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:51:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:51:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:51:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:52:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:52:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:52:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:52:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:52:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:52:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 14:52:00 [DEBUG   ] Finished updating board flags in 2.019 seconds
2013-06-28 14:52:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 14:52:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 14:52:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 14:52:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:52:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:52:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:52:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:52:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:53:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:53:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:53:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:53:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:53:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:53:00 [DEBUG   ] Finished updating board flags in 1.983 seconds
2013-06-28 14:53:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 14:53:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 14:53:39 [DEBUG   ] Got command RPT from MCS: ref #47750
2013-06-28 14:53:39 [DEBUG   ] summary = ERROR
2013-06-28 14:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47750  13 56471 53619301 A  ERRORERROR'
2013-06-28 14:53:39 [DEBUG   ] Got command RPT from MCS: ref #47751
2013-06-28 14:53:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 14:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47751  77 56471 53619302 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 14:53:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 14:53:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:53:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:53:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:53:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:53:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:54:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:54:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:54:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:54:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:54:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:54:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 14:54:00 [DEBUG   ] Finished updating board flags in 1.818 seconds
2013-06-28 14:54:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 14:54:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 14:54:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 14:54:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:54:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:54:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:54:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:54:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:55:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:55:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:55:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:55:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:55:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:55:00 [DEBUG   ] Finished updating board flags in 1.827 seconds
2013-06-28 14:55:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 14:55:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 14:55:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 14:55:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:55:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:55:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:55:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:55:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:56:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:56:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:56:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:56:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:56:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:56:00 [DEBUG   ] Finished updating board flags in 1.878 seconds
2013-06-28 14:56:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 14:56:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 14:56:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 14:56:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:56:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:56:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:56:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:56:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:57:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:57:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:57:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:57:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:57:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:57:00 [DEBUG   ] Finished updating board flags in 1.812 seconds
2013-06-28 14:57:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 14:57:37 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-28 14:57:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 14:57:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:57:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:57:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:57:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:57:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:58:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:58:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:58:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:58:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:58:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:58:00 [DEBUG   ] Finished updating board flags in 1.673 seconds
2013-06-28 14:58:17 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-28 14:58:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 14:58:39 [DEBUG   ] Got command RPT from MCS: ref #47767
2013-06-28 14:58:39 [DEBUG   ] summary = ERROR
2013-06-28 14:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47767  13 56471 53919305 A  ERRORERROR'
2013-06-28 14:58:39 [DEBUG   ] Got command RPT from MCS: ref #47768
2013-06-28 14:58:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 14:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47768  77 56471 53919306 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 14:58:57 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-28 14:58:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:58:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:58:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:58:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:58:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 14:59:00 [DEBUG   ] Finished updating board flags in 1.612 seconds
2013-06-28 14:59:17 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 14:59:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 14:59:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 14:59:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 14:59:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 14:59:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 14:59:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 14:59:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:00:00 [DEBUG   ] Finished updating board flags in 1.590 seconds
2013-06-28 15:00:17 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2013-06-28 15:00:38 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-28 15:00:58 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-28 15:00:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 15:00:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 15:00:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 15:00:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 15:00:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:01:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:01:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:01:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:01:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:01:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:01:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 15:01:00 [DEBUG   ] Finished updating board flags in 1.419 seconds
2013-06-28 15:01:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 15:01:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 15:01:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 15:01:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 15:01:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 15:01:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 15:01:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 15:01:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:02:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:02:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:02:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:02:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:02:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:02:00 [DEBUG   ] Finished updating board flags in 1.389 seconds
2013-06-28 15:02:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 15:02:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 15:02:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 15:03:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 15:03:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 15:03:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 15:03:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 15:03:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:03:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:03:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:03:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:03:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:03:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:03:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 15:03:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-28 15:03:01 [DEBUG   ] Finished updating board flags in 2.232 seconds
2013-06-28 15:03:18 [DEBUG   ] Finished updating ant stats in 1.188 seconds
2013-06-28 15:03:38 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-28 15:03:39 [DEBUG   ] Got command RPT from MCS: ref #47784
2013-06-28 15:03:39 [DEBUG   ] summary = ERROR
2013-06-28 15:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47784  13 56471 54219309 A  ERRORERROR'
2013-06-28 15:03:39 [DEBUG   ] Got command RPT from MCS: ref #47785
2013-06-28 15:03:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 15:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47785  77 56471 54219310 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 15:03:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 15:04:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 15:04:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 15:04:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 15:04:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 15:04:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:04:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:04:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:04:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:04:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:04:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:04:01 [DEBUG   ] Finished updating board flags in 2.170 seconds
2013-06-28 15:04:18 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-28 15:04:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 15:04:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 15:05:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 15:05:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 15:05:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 15:05:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 15:05:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:05:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:05:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:05:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:05:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:05:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:05:01 [DEBUG   ] Finished updating board flags in 2.026 seconds
2013-06-28 15:05:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 15:05:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 15:05:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 15:06:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 15:06:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 15:06:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 15:06:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 15:06:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:06:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:06:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:06:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:06:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:06:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:06:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 15:06:01 [DEBUG   ] Finished updating board flags in 2.018 seconds
2013-06-28 15:06:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 15:06:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 15:06:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 15:07:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 15:07:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 15:07:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 15:07:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 15:07:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:07:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:07:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:07:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:07:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:07:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:07:01 [DEBUG   ] Finished updating board flags in 2.028 seconds
2013-06-28 15:07:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 15:07:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 15:07:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 15:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 15:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 15:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 15:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 15:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:08:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:08:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:08:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:08:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:08:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:08:01 [DEBUG   ] Finished updating board flags in 1.940 seconds
2013-06-28 15:08:18 [DEBUG   ] Finished updating ant stats in 0.581 seconds
2013-06-28 15:08:39 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-28 15:08:39 [DEBUG   ] Got command RPT from MCS: ref #47801
2013-06-28 15:08:39 [DEBUG   ] summary = ERROR
2013-06-28 15:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47801  13 56471 54519313 A  ERRORERROR'
2013-06-28 15:08:39 [DEBUG   ] Got command RPT from MCS: ref #47802
2013-06-28 15:08:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 15:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47802  77 56471 54519314 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 15:08:59 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-28 15:09:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 15:09:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 15:09:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 15:09:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 15:09:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:09:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:09:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:09:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:09:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:09:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:09:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 15:09:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-28 15:09:01 [DEBUG   ] Finished updating board flags in 1.834 seconds
2013-06-28 15:09:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 15:09:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 15:09:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 15:10:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 15:10:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 15:10:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 15:10:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 15:10:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:10:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:10:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:10:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:10:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:10:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:10:01 [DEBUG   ] Finished updating board flags in 1.757 seconds
2013-06-28 15:10:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 15:10:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 15:10:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 15:11:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 15:11:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 15:11:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 15:11:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 15:11:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:11:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:11:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:11:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:11:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:11:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:11:01 [DEBUG   ] Finished updating board flags in 1.625 seconds
2013-06-28 15:11:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 15:11:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 15:11:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 15:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 15:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 15:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 15:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 15:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:12:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 15:12:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 15:12:01 [DEBUG   ] Finished updating board flags in 1.584 seconds
2013-06-28 15:12:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 15:12:39 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-28 15:12:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 15:13:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 15:13:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 15:13:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 15:13:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 15:13:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:13:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:13:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:13:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:13:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:13:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:13:01 [DEBUG   ] Finished updating board flags in 1.418 seconds
2013-06-28 15:13:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 15:13:39 [DEBUG   ] Got command RPT from MCS: ref #47818
2013-06-28 15:13:39 [DEBUG   ] summary = ERROR
2013-06-28 15:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47818  13 56471 54819309 A  ERRORERROR'
2013-06-28 15:13:39 [DEBUG   ] Got command RPT from MCS: ref #47819
2013-06-28 15:13:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 15:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47819  77 56471 54819310 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 15:13:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 15:13:59 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-28 15:14:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 15:14:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 15:14:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 15:14:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 15:14:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:14:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-28 15:14:01 [DEBUG   ] Finished updating board flags in 1.468 seconds
2013-06-28 15:14:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 15:14:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 15:14:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 15:15:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 15:15:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 15:15:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 15:15:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 15:15:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:15:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:15:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:15:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:15:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:15:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:15:02 [DEBUG   ] Finished updating board flags in 2.378 seconds
2013-06-28 15:15:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-28 15:15:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 15:15:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 15:16:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 15:16:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 15:16:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 15:16:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 15:16:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:16:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:16:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:16:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:16:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:16:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:16:02 [DEBUG   ] Finished updating board flags in 2.141 seconds
2013-06-28 15:16:19 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 15:16:39 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-28 15:17:00 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-28 15:17:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 15:17:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 15:17:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 15:17:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 15:17:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:17:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:17:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:17:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:17:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:17:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:17:02 [DEBUG   ] Finished updating board flags in 2.008 seconds
2013-06-28 15:17:20 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-28 15:17:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 15:18:00 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 15:18:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 15:18:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 15:18:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 15:18:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 15:18:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:18:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:18:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:18:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:18:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:18:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:18:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 15:18:02 [DEBUG   ] Finished updating board flags in 1.988 seconds
2013-06-28 15:18:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 15:18:39 [DEBUG   ] Got command RPT from MCS: ref #47835
2013-06-28 15:18:39 [DEBUG   ] summary = ERROR
2013-06-28 15:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47835  13 56471 55119306 A  ERRORERROR'
2013-06-28 15:18:39 [DEBUG   ] Got command RPT from MCS: ref #47836
2013-06-28 15:18:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 15:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47836  77 56471 55119306 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 15:18:40 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 15:19:00 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-28 15:19:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 15:19:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 15:19:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 15:19:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 15:19:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:19:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:19:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:19:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:19:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:19:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:19:02 [DEBUG   ] Finished updating board flags in 1.845 seconds
2013-06-28 15:19:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 15:19:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 15:20:00 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 15:20:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 15:20:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 15:20:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 15:20:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 15:20:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:20:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:20:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:20:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:20:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:20:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:20:02 [DEBUG   ] Finished updating board flags in 1.759 seconds
2013-06-28 15:20:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 15:20:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 15:21:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 15:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 15:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 15:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 15:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 15:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:21:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:21:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:21:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:21:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:21:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:21:02 [DEBUG   ] Finished updating board flags in 1.646 seconds
2013-06-28 15:21:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 15:21:40 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-28 15:22:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 15:22:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 15:22:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 15:22:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 15:22:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 15:22:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:22:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:22:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:22:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:22:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:22:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:22:02 [DEBUG   ] Finished updating board flags in 1.544 seconds
2013-06-28 15:22:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 15:22:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 15:23:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 15:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 15:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 15:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 15:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 15:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:23:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:23:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:23:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:23:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:23:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:23:02 [DEBUG   ] Finished updating board flags in 1.461 seconds
2013-06-28 15:23:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 15:23:39 [DEBUG   ] Got command RPT from MCS: ref #47852
2013-06-28 15:23:39 [DEBUG   ] summary = ERROR
2013-06-28 15:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47852  13 56471 55419317 A  ERRORERROR'
2013-06-28 15:23:39 [DEBUG   ] Got command RPT from MCS: ref #47853
2013-06-28 15:23:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 15:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47853  77 56471 55419318 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 15:23:40 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-28 15:24:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 15:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 15:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 15:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 15:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 15:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:24:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:24:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:24:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:24:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:24:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:24:03 [DEBUG   ] Finished updating board flags in 2.403 seconds
2013-06-28 15:24:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 15:24:40 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-28 15:25:01 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-28 15:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 15:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 15:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 15:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 15:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:25:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:25:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:25:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:25:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:25:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:25:03 [DEBUG   ] Finished updating board flags in 2.356 seconds
2013-06-28 15:25:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 15:25:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 15:26:01 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 15:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 15:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 15:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 15:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 15:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:26:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:26:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:26:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:26:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:26:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:26:03 [DEBUG   ] Finished updating board flags in 2.208 seconds
2013-06-28 15:26:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-28 15:26:41 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2013-06-28 15:27:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 15:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 15:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 15:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 15:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 15:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:27:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:27:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:27:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:27:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:27:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:27:03 [DEBUG   ] Finished updating board flags in 2.188 seconds
2013-06-28 15:27:21 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 15:27:41 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 15:28:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 15:28:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 15:28:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 15:28:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 15:28:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 15:28:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:28:03 [DEBUG   ] Finished updating board flags in 2.035 seconds
2013-06-28 15:28:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 15:28:39 [DEBUG   ] Got command RPT from MCS: ref #47869
2013-06-28 15:28:39 [DEBUG   ] summary = ERROR
2013-06-28 15:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47869  13 56471 55719309 A  ERRORERROR'
2013-06-28 15:28:39 [DEBUG   ] Got command RPT from MCS: ref #47870
2013-06-28 15:28:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 15:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47870  77 56471 55719310 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 15:28:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 15:29:01 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2013-06-28 15:29:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 15:29:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 15:29:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 15:29:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 15:29:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:29:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:29:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:29:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:29:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:29:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:29:03 [DEBUG   ] Finished updating board flags in 1.976 seconds
2013-06-28 15:29:21 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-28 15:29:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 15:30:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 15:30:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 15:30:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 15:30:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 15:30:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 15:30:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:30:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:30:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:30:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:30:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:30:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:30:03 [DEBUG   ] Finished updating board flags in 1.816 seconds
2013-06-28 15:30:21 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 15:30:41 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-28 15:31:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 15:31:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 15:31:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 15:31:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 15:31:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:31:02 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-28 15:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:31:03 [DEBUG   ] Finished updating board flags in 1.798 seconds
2013-06-28 15:31:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 15:31:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 15:32:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 15:32:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 15:32:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 15:32:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 15:32:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:32:02 [DEBUG   ] Finished updating ant stats in 1.249 seconds
2013-06-28 15:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:32:03 [DEBUG   ] Finished updating board flags in 1.605 seconds
2013-06-28 15:32:22 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2013-06-28 15:32:42 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2013-06-28 15:33:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 15:33:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 15:33:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 15:33:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 15:33:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:33:02 [DEBUG   ] Finished updating ant stats in 0.849 seconds
2013-06-28 15:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:33:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 15:33:03 [DEBUG   ] Finished updating board flags in 1.578 seconds
2013-06-28 15:33:22 [DEBUG   ] Finished updating ant stats in 0.754 seconds
2013-06-28 15:33:39 [DEBUG   ] Got command RPT from MCS: ref #47886
2013-06-28 15:33:39 [DEBUG   ] summary = ERROR
2013-06-28 15:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47886  13 56471 56019318 A  ERRORERROR'
2013-06-28 15:33:39 [DEBUG   ] Got command RPT from MCS: ref #47887
2013-06-28 15:33:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 15:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47887  77 56471 56019318 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 15:33:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 15:34:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 15:34:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 15:34:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 15:34:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 15:34:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:34:02 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2013-06-28 15:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:34:03 [DEBUG   ] Finished updating board flags in 1.413 seconds
2013-06-28 15:34:22 [DEBUG   ] Finished updating ant stats in 0.553 seconds
2013-06-28 15:34:43 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-28 15:35:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 15:35:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 15:35:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 15:35:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 15:35:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:35:03 [DEBUG   ] Finished updating ant stats in 1.250 seconds
2013-06-28 15:35:03 [DEBUG   ] Finished updating board flags in 1.448 seconds
2013-06-28 15:35:23 [DEBUG   ] Finished updating ant stats in 1.158 seconds
2013-06-28 15:35:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 15:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 15:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 15:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 15:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 15:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:36:03 [DEBUG   ] Finished updating ant stats in 1.050 seconds
2013-06-28 15:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:36:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 15:36:04 [DEBUG   ] Finished updating board flags in 2.357 seconds
2013-06-28 15:36:23 [DEBUG   ] Finished updating ant stats in 0.955 seconds
2013-06-28 15:36:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 15:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-28 15:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-28 15:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-28 15:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-28 15:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-28 15:37:03 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2013-06-28 15:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-28 15:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-28 15:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-28 15:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-28 15:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-28 15:37:04 [DEBUG   ] Finished updating board flags in 2.191 seconds
2013-06-28 15:37:23 [DEBUG   ] Finished updating ant stats in 0.760 seconds
2013-06-28 15:37:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 196000019
2013-06-28 15:38:03 [DEBUG   ] Finished updating ant stats in 0.650 seconds
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 196000019
2013-06-28 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 196000019
2013-06-28 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 196000019
2013-06-28 15:38:04 [DEBUG   ] Finished updating board flags in 2.037 seconds
2013-06-28 15:38:23 [DEBUG   ] Finished updating ant stats in 0.554 seconds
2013-06-28 15:38:39 [DEBUG   ] Got command RPT from MCS: ref #47903
2013-06-28 15:38:39 [DEBUG   ] summary = ERROR
2013-06-28 15:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47903  13 56471 56319318 A  ERRORERROR'
2013-06-28 15:38:39 [DEBUG   ] Got command RPT from MCS: ref #47904
2013-06-28 15:38:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 15:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47904  77 56471 56319318 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 15:38:44 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-28 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-28 15:39:04 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-28 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-28 15:39:04 [DEBUG   ] Finished updating board flags in 1.976 seconds
2013-06-28 15:39:24 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-28 15:39:44 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 15:40:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 15:40:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 15:40:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 15:40:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 15:40:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 15:40:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 15:40:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 15:40:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 15:40:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 15:40:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 15:40:04 [DEBUG   ] Finished updating ant stats in 1.246 seconds
2013-06-28 15:40:04 [DEBUG   ] Finished updating board flags in 1.863 seconds
2013-06-28 15:40:24 [DEBUG   ] Finished updating ant stats in 1.158 seconds
2013-06-28 15:40:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 15:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 15:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 15:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 15:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 15:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 15:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 15:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 15:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 15:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 15:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 15:41:04 [DEBUG   ] Finished updating ant stats in 1.047 seconds
2013-06-28 15:41:04 [DEBUG   ] Finished updating board flags in 1.787 seconds
2013-06-28 15:41:24 [DEBUG   ] Finished updating ant stats in 0.959 seconds
2013-06-28 15:41:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 15:42:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 15:42:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 15:42:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 15:42:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 15:42:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 15:42:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-28 15:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 15:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 15:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 15:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 15:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 15:42:04 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2013-06-28 15:42:04 [DEBUG   ] Finished updating board flags in 1.625 seconds
2013-06-28 15:42:24 [DEBUG   ] Finished updating ant stats in 0.740 seconds
2013-06-28 15:42:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 15:43:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 15:43:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 15:43:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 15:43:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 15:43:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 15:43:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 15:43:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 15:43:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 15:43:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 15:43:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 15:43:04 [DEBUG   ] Finished updating ant stats in 0.644 seconds
2013-06-28 15:43:04 [DEBUG   ] Finished updating board flags in 1.509 seconds
2013-06-28 15:43:24 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2013-06-28 15:43:39 [DEBUG   ] Got command RPT from MCS: ref #47920
2013-06-28 15:43:39 [DEBUG   ] summary = ERROR
2013-06-28 15:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47920  13 56471 56619321 A  ERRORERROR'
2013-06-28 15:43:39 [DEBUG   ] Got command RPT from MCS: ref #47921
2013-06-28 15:43:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 15:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47921  77 56471 56619322 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 15:43:44 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-28 15:44:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 15:44:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 15:44:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 15:44:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 15:44:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 15:44:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 15:44:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 15:44:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 15:44:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 15:44:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 15:44:05 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-28 15:44:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 15:44:05 [DEBUG   ] Finished updating board flags in 2.374 seconds
2013-06-28 15:44:25 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-28 15:44:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 15:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 15:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 15:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 15:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 15:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 15:45:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 15:45:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 15:45:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 15:45:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 15:45:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 15:45:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 15:45:05 [DEBUG   ] Finished updating ant stats in 1.245 seconds
2013-06-28 15:45:05 [DEBUG   ] Finished updating board flags in 2.245 seconds
2013-06-28 15:45:25 [DEBUG   ] Finished updating ant stats in 1.158 seconds
2013-06-28 15:45:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 15:46:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 15:46:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 15:46:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 15:46:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 15:46:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 15:46:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 15:46:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 15:46:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 15:46:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 15:46:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 15:46:05 [DEBUG   ] Finished updating ant stats in 1.048 seconds
2013-06-28 15:46:05 [DEBUG   ] Finished updating board flags in 2.193 seconds
2013-06-28 15:46:25 [DEBUG   ] Finished updating ant stats in 0.954 seconds
2013-06-28 15:46:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 15:47:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 15:47:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 15:47:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 15:47:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 15:47:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 15:47:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 15:47:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 15:47:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 15:47:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 15:47:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 15:47:05 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2013-06-28 15:47:05 [DEBUG   ] Finished updating board flags in 2.025 seconds
2013-06-28 15:47:25 [DEBUG   ] Finished updating ant stats in 0.760 seconds
2013-06-28 15:47:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 15:48:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 15:48:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 15:48:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 15:48:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 15:48:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 15:48:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 15:48:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 15:48:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 15:48:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 15:48:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 15:48:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 15:48:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2013-06-28 15:48:05 [DEBUG   ] Finished updating ant stats in 0.641 seconds
2013-06-28 15:48:05 [DEBUG   ] Finished updating board flags in 1.973 seconds
2013-06-28 15:48:25 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2013-06-28 15:48:39 [DEBUG   ] Got command RPT from MCS: ref #47937
2013-06-28 15:48:39 [DEBUG   ] summary = ERROR
2013-06-28 15:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47937  13 56471 56919321 A  ERRORERROR'
2013-06-28 15:48:39 [DEBUG   ] Got command RPT from MCS: ref #47938
2013-06-28 15:48:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 15:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47938  77 56471 56919322 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 15:48:45 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-28 15:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 15:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 15:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 15:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 15:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 15:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 15:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 15:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 15:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 15:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 15:49:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 15:49:05 [DEBUG   ] Finished updating board flags in 1.820 seconds
2013-06-28 15:49:06 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-28 15:49:26 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-28 15:49:46 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-28 15:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 15:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 15:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 15:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 15:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 15:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 15:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 15:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 15:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 15:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 15:50:05 [DEBUG   ] Finished updating board flags in 1.813 seconds
2013-06-28 15:50:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 15:50:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 15:50:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 15:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 15:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 15:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 15:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 15:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 15:51:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 15:51:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 15:51:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 15:51:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 15:51:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 15:51:05 [DEBUG   ] Finished updating board flags in 1.788 seconds
2013-06-28 15:51:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 15:51:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 15:51:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 15:52:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 15:52:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 15:52:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 15:52:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 15:52:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 15:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 15:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 15:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 15:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 15:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 15:52:05 [DEBUG   ] Finished updating board flags in 1.618 seconds
2013-06-28 15:52:06 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-28 15:52:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 15:52:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 15:53:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 15:53:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 15:53:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 15:53:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 15:53:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 15:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 15:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 15:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 15:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 15:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 15:53:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 15:53:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 15:53:06 [DEBUG   ] Finished updating board flags in 2.307 seconds
2013-06-28 15:53:26 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-28 15:53:39 [DEBUG   ] Got command RPT from MCS: ref #47954
2013-06-28 15:53:39 [DEBUG   ] summary = ERROR
2013-06-28 15:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47954  13 56471 57219317 A  ERRORERROR'
2013-06-28 15:53:39 [DEBUG   ] Got command RPT from MCS: ref #47955
2013-06-28 15:53:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 15:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47955  77 56471 57219318 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 15:53:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 15:54:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 15:54:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 15:54:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 15:54:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 15:54:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 15:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 15:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 15:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 15:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 15:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 15:54:05 [DEBUG   ] Finished updating board flags in 1.430 seconds
2013-06-28 15:54:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 15:54:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 15:54:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 15:55:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 15:55:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 15:55:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 15:55:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 15:55:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 15:55:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 15:55:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 15:55:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 15:55:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 15:55:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 15:55:05 [DEBUG   ] Finished updating board flags in 1.450 seconds
2013-06-28 15:55:06 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2013-06-28 15:55:27 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-28 15:55:47 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-28 15:56:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 15:56:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 15:56:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 15:56:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 15:56:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 15:56:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 15:56:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 15:56:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 15:56:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 15:56:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 15:56:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 15:56:06 [DEBUG   ] Finished updating board flags in 2.426 seconds
2013-06-28 15:56:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-28 15:56:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 15:56:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 15:57:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 15:57:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 15:57:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 15:57:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 15:57:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 15:57:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-28 15:57:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 15:57:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 15:57:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 15:57:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 15:57:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 15:57:06 [DEBUG   ] Finished updating board flags in 2.369 seconds
2013-06-28 15:57:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 15:57:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 15:57:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 15:58:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 15:58:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 15:58:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 15:58:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 15:58:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 15:58:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 15:58:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 15:58:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 15:58:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 15:58:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 15:58:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 15:58:06 [DEBUG   ] Finished updating board flags in 2.222 seconds
2013-06-28 15:58:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 15:58:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 15:58:39 [DEBUG   ] Got command RPT from MCS: ref #47971
2013-06-28 15:58:39 [DEBUG   ] summary = ERROR
2013-06-28 15:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47971  13 56471 57519317 A  ERRORERROR'
2013-06-28 15:58:39 [DEBUG   ] Got command RPT from MCS: ref #47972
2013-06-28 15:58:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 15:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47972  77 56471 57519318 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 15:58:47 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-28 15:59:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 15:59:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 15:59:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 15:59:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 15:59:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 15:59:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 15:59:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 15:59:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 15:59:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 15:59:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 15:59:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 15:59:06 [DEBUG   ] Finished updating board flags in 2.209 seconds
2013-06-28 15:59:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 15:59:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 15:59:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 16:00:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 16:00:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 16:00:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 16:00:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 16:00:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 16:00:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 16:00:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 16:00:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 16:00:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 16:00:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 16:00:06 [DEBUG   ] Finished updating board flags in 2.163 seconds
2013-06-28 16:00:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 16:00:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 16:00:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 16:01:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 16:01:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 16:01:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 16:01:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 16:01:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 16:01:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 16:01:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 16:01:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 16:01:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 16:01:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 16:01:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 16:01:06 [DEBUG   ] Finished updating board flags in 2.023 seconds
2013-06-28 16:01:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 16:01:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 16:01:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 16:02:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 16:02:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 16:02:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 16:02:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 16:02:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 16:02:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 16:02:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 16:02:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 16:02:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 16:02:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 16:02:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 16:02:06 [DEBUG   ] Finished updating board flags in 1.993 seconds
2013-06-28 16:02:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 16:02:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 16:02:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 16:03:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 16:03:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 16:03:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 16:03:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 16:03:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 16:03:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 16:03:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 16:03:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 16:03:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 16:03:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 16:03:06 [DEBUG   ] Finished updating board flags in 1.880 seconds
2013-06-28 16:03:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 16:03:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 16:03:39 [DEBUG   ] Got command RPT from MCS: ref #47988
2013-06-28 16:03:39 [DEBUG   ] summary = ERROR
2013-06-28 16:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47988  13 56471 57819321 A  ERRORERROR'
2013-06-28 16:03:39 [DEBUG   ] Got command RPT from MCS: ref #47989
2013-06-28 16:03:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 16:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    47989  77 56471 57819322 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 16:03:47 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-28 16:04:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 16:04:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 16:04:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 16:04:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 16:04:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 16:04:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 16:04:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 16:04:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 16:04:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 16:04:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 16:04:06 [DEBUG   ] Finished updating board flags in 1.685 seconds
2013-06-28 16:04:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 16:04:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 16:04:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 16:05:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 16:05:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 16:05:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 16:05:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 16:05:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 16:05:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 16:05:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 16:05:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 16:05:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 16:05:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 16:05:06 [DEBUG   ] Finished updating board flags in 1.596 seconds
2013-06-28 16:05:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 16:05:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 16:05:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 16:06:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 16:06:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 16:06:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 16:06:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 16:06:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 16:06:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 16:06:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 16:06:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 16:06:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 16:06:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 16:06:06 [DEBUG   ] Finished updating board flags in 1.472 seconds
2013-06-28 16:06:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 16:06:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 16:06:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 16:07:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 16:07:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 16:07:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 16:07:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 16:07:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 16:07:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 16:07:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 16:07:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 16:07:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 16:07:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 16:07:07 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2013-06-28 16:07:07 [DEBUG   ] Finished updating board flags in 2.405 seconds
2013-06-28 16:07:27 [DEBUG   ] Finished updating ant stats in 0.556 seconds
2013-06-28 16:07:48 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-28 16:08:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 16:08:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 16:08:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 16:08:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 16:08:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 16:08:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 16:08:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 16:08:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 16:08:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 16:08:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 16:08:07 [DEBUG   ] Finished updating board flags in 2.341 seconds
2013-06-28 16:08:08 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-28 16:08:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 16:08:39 [DEBUG   ] Got command RPT from MCS: ref #48005
2013-06-28 16:08:39 [DEBUG   ] summary = ERROR
2013-06-28 16:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48005  13 56471 58119321 A  ERRORERROR'
2013-06-28 16:08:39 [DEBUG   ] Got command RPT from MCS: ref #48006
2013-06-28 16:08:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 16:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48006  77 56471 58119322 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 16:08:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 16:09:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 16:09:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 16:09:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 16:09:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 16:09:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 16:09:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 16:09:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 16:09:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 16:09:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 16:09:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 16:09:07 [DEBUG   ] Finished updating board flags in 2.237 seconds
2013-06-28 16:09:08 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-28 16:09:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 16:09:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 16:10:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 16:10:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 16:10:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 16:10:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 16:10:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 16:10:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 16:10:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 16:10:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 16:10:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 16:10:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 16:10:07 [DEBUG   ] Finished updating board flags in 2.175 seconds
2013-06-28 16:10:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-28 16:10:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 16:10:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 16:11:07 [DEBUG   ] Finished updating board flags in 2.027 seconds
2013-06-28 16:11:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 16:11:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 16:11:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 16:12:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 16:12:07 [DEBUG   ] Finished updating board flags in 2.005 seconds
2013-06-28 16:12:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 16:12:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 16:12:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 16:13:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 16:13:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 16:13:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 16:13:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 16:13:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 16:13:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 16:13:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 16:13:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 16:13:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 16:13:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 16:13:07 [DEBUG   ] Finished updating board flags in 2.083 seconds
2013-06-28 16:13:08 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-28 16:13:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 16:13:39 [DEBUG   ] Got command RPT from MCS: ref #48022
2013-06-28 16:13:39 [DEBUG   ] summary = ERROR
2013-06-28 16:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48022  13 56471 58419325 A  ERRORERROR'
2013-06-28 16:13:39 [DEBUG   ] Got command RPT from MCS: ref #48023
2013-06-28 16:13:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 16:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48023  77 56471 58419326 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 16:13:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 16:14:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 16:14:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 16:14:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 16:14:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 16:14:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 16:14:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 16:14:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 16:14:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 16:14:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 16:14:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 16:14:07 [DEBUG   ] Finished updating board flags in 1.867 seconds
2013-06-28 16:14:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 16:14:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 16:14:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 16:15:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 16:15:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 16:15:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 16:15:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 16:15:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 16:15:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 16:15:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 16:15:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 16:15:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 16:15:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 16:15:07 [DEBUG   ] Finished updating board flags in 1.817 seconds
2013-06-28 16:15:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 16:15:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 16:15:48 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-28 16:16:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 16:16:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 16:16:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 16:16:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 16:16:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 16:16:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 16:16:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 16:16:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 16:16:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 16:16:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 16:16:07 [DEBUG   ] Finished updating board flags in 1.815 seconds
2013-06-28 16:16:08 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2013-06-28 16:16:29 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-28 16:16:49 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-28 16:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 16:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 16:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 16:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 16:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 16:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 16:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 16:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 16:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 16:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 16:17:07 [DEBUG   ] Finished updating board flags in 1.766 seconds
2013-06-28 16:17:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 16:17:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 16:17:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 16:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 16:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 16:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 16:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 16:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 16:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 16:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 16:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 16:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 16:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 16:18:07 [DEBUG   ] Finished updating board flags in 1.623 seconds
2013-06-28 16:18:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 16:18:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 16:18:39 [DEBUG   ] Got command RPT from MCS: ref #48039
2013-06-28 16:18:39 [DEBUG   ] summary = ERROR
2013-06-28 16:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48039  13 56471 58719321 A  ERRORERROR'
2013-06-28 16:18:39 [DEBUG   ] Got command RPT from MCS: ref #48040
2013-06-28 16:18:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 16:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48040  77 56471 58719322 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 16:18:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 16:19:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 16:19:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 16:19:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 16:19:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 16:19:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 16:19:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 16:19:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 16:19:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 16:19:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 16:19:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 16:19:07 [DEBUG   ] Finished updating board flags in 1.608 seconds
2013-06-28 16:19:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 16:19:29 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 16:19:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 16:20:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 16:20:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 16:20:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 16:20:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 16:20:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 16:20:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 16:20:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 16:20:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 16:20:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 16:20:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 16:20:07 [DEBUG   ] Finished updating board flags in 1.694 seconds
2013-06-28 16:20:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-28 16:20:29 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 16:20:49 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 16:21:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 16:21:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 16:21:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 16:21:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 16:21:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 16:21:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 16:21:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 16:21:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 16:21:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 16:21:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 16:21:07 [DEBUG   ] Finished updating board flags in 1.486 seconds
2013-06-28 16:21:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 16:21:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 16:21:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 16:22:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 16:22:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 16:22:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 16:22:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 16:22:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 16:22:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 16:22:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 16:22:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 16:22:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 16:22:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 16:22:07 [DEBUG   ] Finished updating board flags in 1.479 seconds
2013-06-28 16:22:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 16:22:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 16:22:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 16:23:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 16:23:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 16:23:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 16:23:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 16:23:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 16:23:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 16:23:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 16:23:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 16:23:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 16:23:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 16:23:08 [DEBUG   ] Finished updating board flags in 2.386 seconds
2013-06-28 16:23:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 16:23:29 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-28 16:23:39 [DEBUG   ] Got command RPT from MCS: ref #48056
2013-06-28 16:23:39 [DEBUG   ] summary = ERROR
2013-06-28 16:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48056  13 56471 59019321 A  ERRORERROR'
2013-06-28 16:23:39 [DEBUG   ] Got command RPT from MCS: ref #48057
2013-06-28 16:23:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 16:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48057  77 56471 59019322 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 16:23:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 16:24:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 16:24:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 16:24:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 16:24:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 16:24:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 16:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 16:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 16:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 16:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 16:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 16:24:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 16:24:08 [DEBUG   ] Finished updating board flags in 2.186 seconds
2013-06-28 16:24:09 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-28 16:24:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 16:24:49 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2013-06-28 16:25:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 16:25:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 16:25:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 16:25:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 16:25:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 16:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 16:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 16:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 16:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 16:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 16:25:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 16:25:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 16:25:08 [DEBUG   ] Finished updating board flags in 1.987 seconds
2013-06-28 16:25:09 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-28 16:25:30 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-28 16:25:50 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-28 16:26:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 16:26:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 16:26:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 16:26:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 16:26:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 16:26:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 16:26:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 16:26:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 16:26:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 16:26:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 16:26:08 [DEBUG   ] Finished updating board flags in 1.788 seconds
2013-06-28 16:26:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 16:26:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 16:26:50 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-28 16:27:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 16:27:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 16:27:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 16:27:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 16:27:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 16:27:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 16:27:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 16:27:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 16:27:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 16:27:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 16:27:08 [DEBUG   ] Finished updating board flags in 1.602 seconds
2013-06-28 16:27:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 16:27:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 16:27:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 16:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 16:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 16:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 16:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 16:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 16:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 16:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 16:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 16:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 16:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 16:28:08 [DEBUG   ] Finished updating board flags in 1.592 seconds
2013-06-28 16:28:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 16:28:30 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 16:28:39 [DEBUG   ] Got command RPT from MCS: ref #48073
2013-06-28 16:28:39 [DEBUG   ] summary = ERROR
2013-06-28 16:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48073  13 56471 59319321 A  ERRORERROR'
2013-06-28 16:28:39 [DEBUG   ] Got command RPT from MCS: ref #48074
2013-06-28 16:28:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 16:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48074  77 56471 59319322 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 16:28:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 16:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 16:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 16:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 16:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 16:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 16:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 16:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 16:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 16:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 16:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 16:29:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 16:29:08 [DEBUG   ] Finished updating board flags in 1.458 seconds
2013-06-28 16:29:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 16:29:30 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-28 16:29:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 16:30:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 16:30:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 16:30:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 16:30:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 16:30:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 16:30:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 16:30:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 16:30:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 16:30:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 16:30:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 16:30:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 16:30:10 [DEBUG   ] Finished updating board flags in 3.155 seconds
2013-06-28 16:30:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 16:30:50 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2013-06-28 16:31:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 16:31:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 16:31:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 16:31:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 16:31:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 16:31:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 16:31:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 16:31:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 16:31:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 16:31:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 16:31:09 [DEBUG   ] Finished updating board flags in 2.184 seconds
2013-06-28 16:31:10 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 16:31:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 16:31:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 16:32:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 16:32:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 16:32:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 16:32:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 16:32:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 16:32:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 16:32:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 16:32:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 16:32:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 16:32:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 16:32:09 [DEBUG   ] Finished updating board flags in 2.018 seconds
2013-06-28 16:32:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 16:32:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 16:32:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 16:33:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 16:33:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 16:33:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 16:33:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 16:33:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 16:33:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 16:33:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 16:33:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 16:33:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 16:33:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 16:33:09 [DEBUG   ] Finished updating board flags in 2.043 seconds
2013-06-28 16:33:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 16:33:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 16:33:39 [DEBUG   ] Got command RPT from MCS: ref #48090
2013-06-28 16:33:39 [DEBUG   ] summary = ERROR
2013-06-28 16:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48090  13 56471 59619325 A  ERRORERROR'
2013-06-28 16:33:39 [DEBUG   ] Got command RPT from MCS: ref #48091
2013-06-28 16:33:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 16:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48091  77 56471 59619326 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 16:33:50 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 16:34:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-28 16:34:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-28 16:34:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-28 16:34:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-28 16:34:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-28 16:34:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-28 16:34:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-28 16:34:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-28 16:34:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-28 16:34:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-28 16:34:09 [DEBUG   ] Finished updating board flags in 2.027 seconds
2013-06-28 16:34:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 16:34:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 16:34:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999489
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 196000019
2013-06-28 16:35:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 196000019
2013-06-28 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 196000019
2013-06-28 16:35:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 196000019
2013-06-28 16:35:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 196000019
2013-06-28 16:35:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 196000019
2013-06-28 16:35:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 196000019
2013-06-28 16:35:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 196000019
2013-06-28 16:35:10 [DEBUG   ] Finished updating board flags in 2.584 seconds
2013-06-28 16:35:10 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 16:35:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 16:35:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-28 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-28 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-28 16:36:09 [DEBUG   ] Finished updating board flags in 1.756 seconds
2013-06-28 16:36:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 16:36:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 16:36:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 16:37:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 16:37:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 16:37:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 16:37:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 16:37:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 16:37:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 16:37:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 16:37:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 16:37:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 16:37:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 16:37:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 16:37:09 [DEBUG   ] Finished updating board flags in 1.612 seconds
2013-06-28 16:37:10 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-28 16:37:30 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-28 16:37:51 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-28 16:38:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 16:38:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 16:38:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 16:38:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 16:38:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 16:38:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 16:38:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 16:38:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 16:38:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 16:38:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 16:38:09 [DEBUG   ] Finished updating board flags in 1.582 seconds
2013-06-28 16:38:11 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-28 16:38:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 16:38:39 [DEBUG   ] Got command RPT from MCS: ref #48107
2013-06-28 16:38:39 [DEBUG   ] summary = ERROR
2013-06-28 16:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48107  13 56471 59919333 A  ERRORERROR'
2013-06-28 16:38:39 [DEBUG   ] Got command RPT from MCS: ref #48108
2013-06-28 16:38:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 16:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48108  77 56471 59919334 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 16:38:51 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 16:39:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 16:39:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 16:39:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 16:39:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 16:39:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 16:39:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 16:39:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 16:39:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 16:39:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 16:39:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 16:39:09 [DEBUG   ] Finished updating board flags in 1.414 seconds
2013-06-28 16:39:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 16:39:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 16:39:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 16:40:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 16:40:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 16:40:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 16:40:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 16:40:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 16:40:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 16:40:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 16:40:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 16:40:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 16:40:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 16:40:09 [DEBUG   ] Finished updating board flags in 1.388 seconds
2013-06-28 16:40:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 16:40:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 16:40:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 16:41:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 16:41:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 16:41:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 16:41:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 16:41:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 16:41:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 16:41:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 16:41:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 16:41:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 16:41:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 16:41:10 [DEBUG   ] Finished updating board flags in 2.248 seconds
2013-06-28 16:41:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 16:41:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 16:41:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 16:42:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 16:42:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 16:42:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 16:42:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 16:42:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 16:42:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 16:42:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 16:42:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 16:42:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 16:42:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 16:42:10 [DEBUG   ] Finished updating board flags in 2.191 seconds
2013-06-28 16:42:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 16:42:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 16:42:51 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 16:43:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 16:43:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 16:43:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 16:43:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 16:43:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 16:43:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 16:43:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 16:43:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 16:43:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 16:43:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 16:43:10 [DEBUG   ] Finished updating board flags in 2.058 seconds
2013-06-28 16:43:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 16:43:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 16:43:39 [DEBUG   ] Got command RPT from MCS: ref #48124
2013-06-28 16:43:39 [DEBUG   ] summary = ERROR
2013-06-28 16:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48124  13 56471 60219333 A  ERRORERROR'
2013-06-28 16:43:39 [DEBUG   ] Got command RPT from MCS: ref #48125
2013-06-28 16:43:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 16:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48125  77 56471 60219334 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 16:43:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 16:44:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 16:44:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 16:44:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 16:44:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 16:44:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 16:44:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 16:44:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 16:44:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 16:44:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 16:44:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 16:44:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 16:44:11 [DEBUG   ] Finished updating board flags in 3.149 seconds
2013-06-28 16:44:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 16:44:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 16:45:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 16:45:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 16:45:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 16:45:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 16:45:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 16:45:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 16:45:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 16:45:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 16:45:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 16:45:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 16:45:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 16:45:10 [DEBUG   ] Finished updating board flags in 1.789 seconds
2013-06-28 16:45:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 16:45:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 16:45:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 16:46:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 16:46:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 16:46:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 16:46:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 16:46:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 16:46:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 16:46:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 16:46:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 16:46:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 16:46:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 16:46:10 [DEBUG   ] Finished updating board flags in 1.621 seconds
2013-06-28 16:46:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 16:46:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 16:46:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 16:47:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 16:47:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 16:47:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 16:47:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 16:47:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 16:47:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 16:47:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 16:47:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 16:47:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 16:47:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 16:47:10 [DEBUG   ] Finished updating board flags in 1.613 seconds
2013-06-28 16:47:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 16:47:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 16:47:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 16:48:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 16:48:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 16:48:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 16:48:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 16:48:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 16:48:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 16:48:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 16:48:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 16:48:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 16:48:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 16:48:10 [DEBUG   ] Finished updating board flags in 1.608 seconds
2013-06-28 16:48:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 16:48:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 16:48:39 [DEBUG   ] Got command RPT from MCS: ref #48141
2013-06-28 16:48:39 [DEBUG   ] summary = ERROR
2013-06-28 16:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48141  13 56471 60519333 A  ERRORERROR'
2013-06-28 16:48:39 [DEBUG   ] Got command RPT from MCS: ref #48142
2013-06-28 16:48:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 16:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48142  77 56471 60519334 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 16:48:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 16:49:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 16:49:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 16:49:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 16:49:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 16:49:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 16:49:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 16:49:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 16:49:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 16:49:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 16:49:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 16:49:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 16:49:10 [DEBUG   ] Finished updating board flags in 1.575 seconds
2013-06-28 16:49:11 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-28 16:49:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 16:49:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 16:50:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 16:50:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 16:50:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 16:50:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 16:50:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 16:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 16:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 16:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 16:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 16:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 16:50:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-28 16:50:11 [DEBUG   ] Finished updating ant stats in 1.048 seconds
2013-06-28 16:50:11 [DEBUG   ] Finished updating board flags in 2.423 seconds
2013-06-28 16:50:31 [DEBUG   ] Finished updating ant stats in 0.954 seconds
2013-06-28 16:50:51 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 16:51:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 16:51:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 16:51:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 16:51:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 16:51:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 16:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 16:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 16:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 16:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 16:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 16:51:11 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2013-06-28 16:51:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 16:51:11 [DEBUG   ] Finished updating board flags in 2.411 seconds
2013-06-28 16:51:31 [DEBUG   ] Finished updating ant stats in 0.759 seconds
2013-06-28 16:51:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 16:52:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 16:52:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 16:52:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 16:52:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 16:52:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 16:52:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 16:52:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 16:52:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 16:52:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 16:52:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 16:52:11 [DEBUG   ] Finished updating ant stats in 0.644 seconds
2013-06-28 16:52:11 [DEBUG   ] Finished updating board flags in 2.374 seconds
2013-06-28 16:52:31 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2013-06-28 16:52:52 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-28 16:53:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 16:53:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 16:53:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 16:53:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 16:53:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 16:53:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 16:53:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 16:53:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 16:53:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 16:53:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 16:53:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 16:53:11 [DEBUG   ] Finished updating board flags in 2.227 seconds
2013-06-28 16:53:12 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-28 16:53:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 16:53:39 [DEBUG   ] Got command RPT from MCS: ref #48158
2013-06-28 16:53:39 [DEBUG   ] summary = ERROR
2013-06-28 16:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48158  13 56471 60819333 A  ERRORERROR'
2013-06-28 16:53:39 [DEBUG   ] Got command RPT from MCS: ref #48159
2013-06-28 16:53:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 16:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48159  77 56471 60819334 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 16:53:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 16:54:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 16:54:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 16:54:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 16:54:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 16:54:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 16:54:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 16:54:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 16:54:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 16:54:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 16:54:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 16:54:12 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-28 16:54:12 [DEBUG   ] Finished updating board flags in 3.407 seconds
2013-06-28 16:54:32 [DEBUG   ] Finished updating ant stats in 0.993 seconds
2013-06-28 16:54:52 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 16:55:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 16:55:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 16:55:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 16:55:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 16:55:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 16:55:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-28 16:55:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 16:55:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 16:55:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 16:55:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 16:55:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 16:55:11 [DEBUG   ] Finished updating board flags in 2.203 seconds
2013-06-28 16:55:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 16:55:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 16:55:52 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 16:56:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 16:56:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 16:56:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 16:56:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 16:56:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 16:56:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 16:56:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 16:56:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 16:56:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 16:56:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 16:56:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-28 16:56:11 [DEBUG   ] Finished updating board flags in 2.185 seconds
2013-06-28 16:56:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 16:56:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 16:56:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 16:57:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 16:57:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 16:57:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 16:57:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 16:57:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 16:57:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 16:57:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 16:57:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 16:57:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 16:57:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 16:57:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 16:57:11 [DEBUG   ] Finished updating board flags in 1.991 seconds
2013-06-28 16:57:12 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 16:57:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 16:57:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 16:58:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 16:58:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 16:58:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 16:58:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 16:58:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 16:58:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 16:58:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 16:58:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 16:58:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 16:58:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 16:58:11 [DEBUG   ] Finished updating board flags in 1.803 seconds
2013-06-28 16:58:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 16:58:32 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 16:58:39 [DEBUG   ] Got command RPT from MCS: ref #48175
2013-06-28 16:58:39 [DEBUG   ] summary = ERROR
2013-06-28 16:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48175  13 56471 61119329 A  ERRORERROR'
2013-06-28 16:58:39 [DEBUG   ] Got command RPT from MCS: ref #48176
2013-06-28 16:58:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 16:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48176  77 56471 61119330 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 16:58:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 16:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 16:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 16:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 16:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 16:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 16:59:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 16:59:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 16:59:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 16:59:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 16:59:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 16:59:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 16:59:11 [DEBUG   ] Finished updating board flags in 1.852 seconds
2013-06-28 16:59:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 16:59:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 16:59:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 17:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:00:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:00:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:00:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:00:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:00:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:00:11 [DEBUG   ] Finished updating board flags in 1.847 seconds
2013-06-28 17:00:12 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 17:00:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 17:00:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 17:01:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:01:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:01:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:01:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:01:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:01:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:01:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:01:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:01:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:01:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:01:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 17:01:11 [DEBUG   ] Finished updating board flags in 1.692 seconds
2013-06-28 17:01:12 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2013-06-28 17:01:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 17:01:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 17:02:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:02:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:02:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:02:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:02:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:02:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:02:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:02:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:02:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:02:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:02:11 [DEBUG   ] Finished updating board flags in 1.622 seconds
2013-06-28 17:02:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 17:02:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 17:02:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 17:03:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:03:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:03:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:03:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:03:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:03:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:03:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:03:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:03:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:03:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:03:11 [DEBUG   ] Finished updating board flags in 1.543 seconds
2013-06-28 17:03:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 17:03:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 17:03:39 [DEBUG   ] Got command RPT from MCS: ref #48192
2013-06-28 17:03:39 [DEBUG   ] summary = ERROR
2013-06-28 17:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48192  13 56471 61419337 A  ERRORERROR'
2013-06-28 17:03:39 [DEBUG   ] Got command RPT from MCS: ref #48193
2013-06-28 17:03:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 17:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48193  77 56471 61419338 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 17:03:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 17:04:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:04:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:04:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:04:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:04:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:04:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:04:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:04:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:04:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:04:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:04:11 [DEBUG   ] Finished updating board flags in 1.458 seconds
2013-06-28 17:04:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 17:04:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 17:04:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 17:05:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:05:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:05:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:05:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:05:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:05:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:05:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:05:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:05:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:05:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:05:12 [DEBUG   ] Finished updating ant stats in 0.644 seconds
2013-06-28 17:05:12 [DEBUG   ] Finished updating board flags in 2.416 seconds
2013-06-28 17:05:32 [DEBUG   ] Finished updating ant stats in 0.557 seconds
2013-06-28 17:05:53 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-28 17:06:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:06:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:06:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:06:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:06:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:06:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:06:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:06:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:06:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:06:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:06:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 17:06:12 [DEBUG   ] Finished updating board flags in 2.355 seconds
2013-06-28 17:06:13 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-28 17:06:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 17:06:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 17:07:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:07:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:07:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:07:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:07:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:07:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:07:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:07:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:07:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:07:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:07:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 17:07:12 [DEBUG   ] Finished updating board flags in 2.248 seconds
2013-06-28 17:07:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 17:07:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 17:07:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 17:08:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:08:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:08:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:08:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:08:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:08:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:08:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:08:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:08:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:08:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:08:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-28 17:08:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 17:08:12 [DEBUG   ] Finished updating board flags in 2.215 seconds
2013-06-28 17:08:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 17:08:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 17:08:39 [DEBUG   ] Got command RPT from MCS: ref #48209
2013-06-28 17:08:39 [DEBUG   ] summary = ERROR
2013-06-28 17:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48209  13 56471 61719329 A  ERRORERROR'
2013-06-28 17:08:39 [DEBUG   ] Got command RPT from MCS: ref #48210
2013-06-28 17:08:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 17:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48210  77 56471 61719330 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 17:08:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 17:09:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:09:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:09:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:09:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:09:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:09:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:09:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:09:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:09:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:09:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:09:12 [DEBUG   ] Finished updating board flags in 2.240 seconds
2013-06-28 17:09:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 17:09:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 17:09:53 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 17:10:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:10:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:10:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:10:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:10:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:10:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:10:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:10:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:10:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:10:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:10:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 17:10:12 [DEBUG   ] Finished updating board flags in 2.136 seconds
2013-06-28 17:10:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 17:10:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 17:10:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 17:11:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:11:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:11:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:11:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:11:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:11:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:11:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:11:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:11:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:11:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:11:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 17:11:12 [DEBUG   ] Finished updating board flags in 2.052 seconds
2013-06-28 17:11:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 17:11:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 17:11:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 17:12:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:12:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:12:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:12:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:12:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:12:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:12:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:12:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:12:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:12:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:12:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 17:12:12 [DEBUG   ] Finished updating board flags in 1.932 seconds
2013-06-28 17:12:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 17:12:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 17:12:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 17:13:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:13:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:13:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:13:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:13:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:13:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:13:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:13:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:13:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:13:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:13:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 17:13:12 [DEBUG   ] Finished updating board flags in 1.817 seconds
2013-06-28 17:13:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 17:13:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 17:13:39 [DEBUG   ] Got command RPT from MCS: ref #48226
2013-06-28 17:13:39 [DEBUG   ] summary = ERROR
2013-06-28 17:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48226  13 56471 62019333 A  ERRORERROR'
2013-06-28 17:13:39 [DEBUG   ] Got command RPT from MCS: ref #48227
2013-06-28 17:13:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 17:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48227  77 56471 62019334 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 17:13:53 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 17:14:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:14:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:14:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:14:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:14:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:14:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:14:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:14:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:14:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:14:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:14:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 17:14:12 [DEBUG   ] Finished updating board flags in 1.828 seconds
2013-06-28 17:14:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 17:14:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 17:14:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 17:15:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:15:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:15:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:15:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:15:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:15:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:15:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:15:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:15:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:15:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:15:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 17:15:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 17:15:12 [DEBUG   ] Finished updating board flags in 1.782 seconds
2013-06-28 17:15:13 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-28 17:15:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 17:15:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 17:16:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:16:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:16:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:16:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:16:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:16:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:16:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:16:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:16:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:16:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:16:12 [DEBUG   ] Finished updating board flags in 1.641 seconds
2013-06-28 17:16:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 17:16:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 17:16:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 17:17:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:17:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:17:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:17:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:17:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:17:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:17:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:17:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:17:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:17:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:17:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 17:17:13 [DEBUG   ] Finished updating board flags in 2.737 seconds
2013-06-28 17:17:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 17:17:53 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 17:18:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:18:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:18:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:18:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:18:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:18:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:18:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:18:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:18:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:18:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:18:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 17:18:13 [DEBUG   ] Finished updating board flags in 2.708 seconds
2013-06-28 17:18:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 17:18:39 [DEBUG   ] Got command RPT from MCS: ref #48243
2013-06-28 17:18:39 [DEBUG   ] summary = ERROR
2013-06-28 17:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48243  13 56471 62319329 A  ERRORERROR'
2013-06-28 17:18:39 [DEBUG   ] Got command RPT from MCS: ref #48244
2013-06-28 17:18:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 17:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48244  77 56471 62319330 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 17:18:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 17:19:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:19:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:19:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:19:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:19:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:19:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:19:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:19:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:19:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:19:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:19:13 [DEBUG   ] Finished updating ant stats in 1.249 seconds
2013-06-28 17:19:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 17:19:13 [DEBUG   ] Finished updating board flags in 2.346 seconds
2013-06-28 17:19:33 [DEBUG   ] Finished updating ant stats in 1.153 seconds
2013-06-28 17:19:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 17:20:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:20:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:20:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:20:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:20:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:20:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:20:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:20:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:20:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:20:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:20:13 [DEBUG   ] Finished updating ant stats in 1.047 seconds
2013-06-28 17:20:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 17:20:13 [DEBUG   ] Finished updating board flags in 2.188 seconds
2013-06-28 17:20:33 [DEBUG   ] Finished updating ant stats in 0.957 seconds
2013-06-28 17:20:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 17:21:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:21:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:21:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:21:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:21:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:21:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:21:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:21:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:21:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:21:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:21:13 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2013-06-28 17:21:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-28 17:21:13 [DEBUG   ] Finished updating board flags in 2.010 seconds
2013-06-28 17:21:33 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2013-06-28 17:21:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 17:22:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:22:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:22:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:22:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:22:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:22:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:22:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:22:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:22:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:22:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:22:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 17:22:13 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2013-06-28 17:22:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-28 17:22:13 [DEBUG   ] Finished updating board flags in 1.969 seconds
2013-06-28 17:22:33 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2013-06-28 17:22:53 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-28 17:23:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:23:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:23:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:23:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:23:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:23:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:23:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:23:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:23:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:23:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:23:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 17:23:13 [DEBUG   ] Finished updating board flags in 1.832 seconds
2013-06-28 17:23:14 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-28 17:23:34 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-28 17:23:39 [DEBUG   ] Got command RPT from MCS: ref #48300
2013-06-28 17:23:39 [DEBUG   ] summary = ERROR
2013-06-28 17:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48300  13 56471 62619337 A  ERRORERROR'
2013-06-28 17:23:39 [DEBUG   ] Got command RPT from MCS: ref #48301
2013-06-28 17:23:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 17:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48301  77 56471 62619338 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 17:23:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 17:24:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:24:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:24:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:24:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:24:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:24:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:24:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:24:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:24:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:24:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:24:13 [DEBUG   ] Finished updating board flags in 1.768 seconds
2013-06-28 17:24:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 17:24:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 17:24:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 17:25:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:25:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:25:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:25:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:25:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:25:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:25:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:25:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:25:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:25:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:25:13 [DEBUG   ] Finished updating board flags in 1.658 seconds
2013-06-28 17:25:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 17:25:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 17:25:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 17:26:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:26:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:26:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:26:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:26:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:26:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:26:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:26:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:26:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:26:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:26:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 17:26:13 [DEBUG   ] Finished updating board flags in 1.536 seconds
2013-06-28 17:26:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 17:26:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 17:26:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 17:27:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:27:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:27:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:27:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:27:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:27:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:27:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:27:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:27:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:27:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:27:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 17:27:13 [DEBUG   ] Finished updating board flags in 1.591 seconds
2013-06-28 17:27:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 17:27:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 17:27:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 17:28:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:28:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:28:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:28:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:28:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:28:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:28:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:28:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:28:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:28:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:28:14 [DEBUG   ] Finished updating ant stats in 1.254 seconds
2013-06-28 17:28:14 [DEBUG   ] Finished updating board flags in 2.355 seconds
2013-06-28 17:28:34 [DEBUG   ] Finished updating ant stats in 1.149 seconds
2013-06-28 17:28:39 [DEBUG   ] Got command RPT from MCS: ref #48352
2013-06-28 17:28:39 [DEBUG   ] summary = ERROR
2013-06-28 17:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48352  13 56471 62919341 A  ERRORERROR'
2013-06-28 17:28:39 [DEBUG   ] Got command RPT from MCS: ref #48353
2013-06-28 17:28:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 17:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48353  77 56471 62919342 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 17:28:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 17:29:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:29:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:29:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:29:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:29:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:29:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:29:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:29:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:29:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:29:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:29:14 [DEBUG   ] Finished updating ant stats in 1.051 seconds
2013-06-28 17:29:14 [DEBUG   ] Finished updating board flags in 2.219 seconds
2013-06-28 17:29:34 [DEBUG   ] Finished updating ant stats in 0.948 seconds
2013-06-28 17:29:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 17:30:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:30:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:30:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:30:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:30:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:30:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:30:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:30:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:30:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:30:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:30:14 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2013-06-28 17:30:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 17:30:14 [DEBUG   ] Finished updating board flags in 2.069 seconds
2013-06-28 17:30:34 [DEBUG   ] Finished updating ant stats in 0.757 seconds
2013-06-28 17:30:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 17:31:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:31:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:31:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:31:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:31:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:31:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:31:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:31:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:31:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:31:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:31:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 17:31:14 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2013-06-28 17:31:14 [DEBUG   ] Finished updating board flags in 2.018 seconds
2013-06-28 17:31:34 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2013-06-28 17:31:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-28 17:32:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:32:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:32:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:32:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:32:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:32:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:32:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:32:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:32:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:32:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:32:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-28 17:32:14 [DEBUG   ] Finished updating ant stats in 0.443 seconds
2013-06-28 17:32:14 [DEBUG   ] Finished updating board flags in 1.984 seconds
2013-06-28 17:32:35 [DEBUG   ] Finished updating ant stats in 1.363 seconds
2013-06-28 17:32:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 17:33:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:33:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:33:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:33:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:33:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:33:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:33:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:33:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:33:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:33:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:33:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 17:33:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 17:33:14 [DEBUG   ] Finished updating board flags in 1.808 seconds
2013-06-28 17:33:15 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-28 17:33:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 17:33:39 [DEBUG   ] Got command RPT from MCS: ref #48369
2013-06-28 17:33:39 [DEBUG   ] summary = ERROR
2013-06-28 17:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48369  13 56471 63219333 A  ERRORERROR'
2013-06-28 17:33:39 [DEBUG   ] Got command RPT from MCS: ref #48370
2013-06-28 17:33:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 17:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48370  77 56471 63219334 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 17:33:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 17:34:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:34:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:34:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:34:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:34:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:34:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:34:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:34:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:34:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:34:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:34:14 [DEBUG   ] Finished updating board flags in 1.772 seconds
2013-06-28 17:34:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 17:34:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 17:34:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 17:35:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:35:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:35:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:35:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:35:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:35:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:35:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:35:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:35:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:35:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:35:14 [DEBUG   ] Finished updating board flags in 1.630 seconds
2013-06-28 17:35:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 17:35:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 17:35:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 17:36:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:36:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:36:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:36:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:36:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:36:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:36:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:36:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:36:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:36:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:36:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 17:36:14 [DEBUG   ] Finished updating board flags in 1.623 seconds
2013-06-28 17:36:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 17:36:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 17:36:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 17:37:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:37:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:37:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:37:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:37:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:37:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:37:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:37:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:37:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:37:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:37:14 [DEBUG   ] Finished updating board flags in 1.616 seconds
2013-06-28 17:37:15 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2013-06-28 17:37:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 17:37:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 17:38:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:38:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:38:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:38:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:38:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:38:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:38:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:38:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:38:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:38:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:38:14 [DEBUG   ] Finished updating board flags in 1.566 seconds
2013-06-28 17:38:15 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 17:38:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 17:38:39 [DEBUG   ] Got command RPT from MCS: ref #48386
2013-06-28 17:38:39 [DEBUG   ] summary = ERROR
2013-06-28 17:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48386  13 56471 63519341 A  ERRORERROR'
2013-06-28 17:38:39 [DEBUG   ] Got command RPT from MCS: ref #48387
2013-06-28 17:38:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 17:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48387  77 56471 63519342 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 17:38:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 17:39:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:39:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:39:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:39:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:39:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:39:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:39:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:39:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:39:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:39:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:39:15 [DEBUG   ] Finished updating ant stats in 1.053 seconds
2013-06-28 17:39:15 [DEBUG   ] Finished updating board flags in 2.487 seconds
2013-06-28 17:39:35 [DEBUG   ] Finished updating ant stats in 0.950 seconds
2013-06-28 17:39:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 17:40:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:40:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:40:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:40:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:40:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:40:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:40:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:40:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:40:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:40:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:40:15 [DEBUG   ] Finished updating ant stats in 0.844 seconds
2013-06-28 17:40:15 [DEBUG   ] Finished updating board flags in 2.313 seconds
2013-06-28 17:40:35 [DEBUG   ] Finished updating ant stats in 0.759 seconds
2013-06-28 17:40:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 17:41:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:41:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:41:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:41:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:41:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:41:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:41:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:41:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:41:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:41:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:41:15 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2013-06-28 17:41:15 [DEBUG   ] Finished updating board flags in 2.223 seconds
2013-06-28 17:41:35 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2013-06-28 17:41:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-28 17:42:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:42:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:42:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:42:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:42:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:42:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:42:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:42:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:42:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:42:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:42:15 [DEBUG   ] Finished updating ant stats in 0.446 seconds
2013-06-28 17:42:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 17:42:15 [DEBUG   ] Finished updating board flags in 2.175 seconds
2013-06-28 17:42:36 [DEBUG   ] Finished updating ant stats in 1.357 seconds
2013-06-28 17:42:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 17:43:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:43:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:43:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:43:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:43:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:43:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:43:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:43:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:43:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:43:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:43:15 [DEBUG   ] Finished updating board flags in 2.022 seconds
2013-06-28 17:43:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 17:43:36 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 17:43:39 [DEBUG   ] Got command RPT from MCS: ref #48403
2013-06-28 17:43:39 [DEBUG   ] summary = ERROR
2013-06-28 17:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48403  13 56471 63819337 A  ERRORERROR'
2013-06-28 17:43:39 [DEBUG   ] Got command RPT from MCS: ref #48404
2013-06-28 17:43:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 17:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48404  77 56471 63819338 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 17:43:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 17:44:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:44:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:44:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:44:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:44:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:44:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:44:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:44:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:44:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:44:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:44:15 [DEBUG   ] Finished updating board flags in 1.980 seconds
2013-06-28 17:44:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 17:44:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 17:44:56 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 17:45:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:45:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:45:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:45:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:45:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:45:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:45:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:45:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:45:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:45:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:45:15 [DEBUG   ] Finished updating board flags in 1.836 seconds
2013-06-28 17:45:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 17:45:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 17:45:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 17:46:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:46:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:46:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:46:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:46:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:46:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:46:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:46:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:46:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:46:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:46:15 [DEBUG   ] Finished updating board flags in 1.838 seconds
2013-06-28 17:46:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 17:46:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 17:46:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 17:47:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:47:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:47:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:47:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:47:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:47:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:47:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:47:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:47:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:47:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:47:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 17:47:15 [DEBUG   ] Finished updating board flags in 1.731 seconds
2013-06-28 17:47:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 17:47:36 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 17:47:56 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 17:48:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:48:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:48:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:48:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:48:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:48:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:48:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:48:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:48:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:48:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:48:15 [DEBUG   ] Finished updating board flags in 1.685 seconds
2013-06-28 17:48:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 17:48:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 17:48:39 [DEBUG   ] Got command RPT from MCS: ref #48420
2013-06-28 17:48:39 [DEBUG   ] summary = ERROR
2013-06-28 17:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48420  13 56471 64119341 A  ERRORERROR'
2013-06-28 17:48:39 [DEBUG   ] Got command RPT from MCS: ref #48421
2013-06-28 17:48:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 17:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48421  77 56471 64119342 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 17:48:56 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 17:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:49:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:49:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:49:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:49:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:49:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:49:15 [DEBUG   ] Finished updating board flags in 1.496 seconds
2013-06-28 17:49:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 17:49:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 17:49:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 17:50:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:50:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:50:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:50:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:50:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:50:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:50:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:50:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:50:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:50:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:50:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 17:50:15 [DEBUG   ] Finished updating board flags in 1.537 seconds
2013-06-28 17:50:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 17:50:36 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2013-06-28 17:50:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 17:51:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:51:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:51:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:51:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:51:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:51:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:51:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:51:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:51:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:51:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:51:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 17:51:16 [DEBUG   ] Finished updating ant stats in 1.045 seconds
2013-06-28 17:51:16 [DEBUG   ] Finished updating board flags in 2.310 seconds
2013-06-28 17:51:36 [DEBUG   ] Finished updating ant stats in 0.957 seconds
2013-06-28 17:51:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 17:52:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:52:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:52:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:52:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:52:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:52:16 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2013-06-28 17:52:16 [DEBUG   ] Finished updating board flags in 2.189 seconds
2013-06-28 17:52:36 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2013-06-28 17:52:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 17:53:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:53:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:53:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:53:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:53:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:53:16 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2013-06-28 17:53:16 [DEBUG   ] Finished updating board flags in 2.030 seconds
2013-06-28 17:53:36 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2013-06-28 17:53:39 [DEBUG   ] Got command RPT from MCS: ref #48437
2013-06-28 17:53:39 [DEBUG   ] summary = ERROR
2013-06-28 17:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48437  13 56471 64419345 A  ERRORERROR'
2013-06-28 17:53:39 [DEBUG   ] Got command RPT from MCS: ref #48438
2013-06-28 17:53:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 17:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48438  77 56471 64419346 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 17:53:57 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-28 17:54:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:54:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:54:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:54:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:54:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:54:16 [DEBUG   ] Finished updating board flags in 1.954 seconds
2013-06-28 17:54:17 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-28 17:54:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 17:54:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 17:55:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:55:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:55:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:55:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:55:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:55:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:55:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:55:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:55:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:55:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:55:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 17:55:16 [DEBUG   ] Finished updating board flags in 1.828 seconds
2013-06-28 17:55:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 17:55:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 17:55:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 17:56:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:56:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:56:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:56:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:56:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:56:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:56:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:56:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:56:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:56:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:56:16 [DEBUG   ] Finished updating board flags in 1.846 seconds
2013-06-28 17:56:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 17:56:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 17:56:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 17:57:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:57:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:57:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:57:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:57:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:57:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:57:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:57:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:57:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:57:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:57:16 [DEBUG   ] Finished updating board flags in 1.769 seconds
2013-06-28 17:57:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 17:57:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 17:57:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 17:58:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:58:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:58:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:58:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:58:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:58:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:58:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:58:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:58:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:58:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:58:16 [DEBUG   ] Finished updating board flags in 1.638 seconds
2013-06-28 17:58:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 17:58:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 17:58:39 [DEBUG   ] Got command RPT from MCS: ref #48454
2013-06-28 17:58:39 [DEBUG   ] summary = ERROR
2013-06-28 17:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48454  13 56471 64719345 A  ERRORERROR'
2013-06-28 17:58:39 [DEBUG   ] Got command RPT from MCS: ref #48455
2013-06-28 17:58:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 17:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48455  77 56471 64719346 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 17:58:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 17:59:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 17:59:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 17:59:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 17:59:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 17:59:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 17:59:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 17:59:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 17:59:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 17:59:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 17:59:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 17:59:16 [DEBUG   ] Finished updating board flags in 1.556 seconds
2013-06-28 17:59:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 17:59:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 17:59:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 18:00:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:00:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:00:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:00:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:00:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:00:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:00:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:00:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:00:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:00:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:00:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 18:00:17 [DEBUG   ] Finished updating ant stats in 1.245 seconds
2013-06-28 18:00:17 [DEBUG   ] Finished updating board flags in 2.440 seconds
2013-06-28 18:00:37 [DEBUG   ] Finished updating ant stats in 1.157 seconds
2013-06-28 18:00:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 18:01:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:01:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:01:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:01:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:01:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:01:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:01:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:01:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:01:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:01:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:01:17 [DEBUG   ] Finished updating ant stats in 1.048 seconds
2013-06-28 18:01:17 [DEBUG   ] Finished updating board flags in 2.365 seconds
2013-06-28 18:01:37 [DEBUG   ] Finished updating ant stats in 0.953 seconds
2013-06-28 18:01:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 18:02:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:02:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:02:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:02:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:02:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:02:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:02:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:02:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:02:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:02:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:02:17 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2013-06-28 18:02:17 [DEBUG   ] Finished updating board flags in 2.217 seconds
2013-06-28 18:02:37 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2013-06-28 18:02:57 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-28 18:03:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:03:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:03:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:03:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:03:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:03:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:03:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:03:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:03:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:03:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:03:17 [DEBUG   ] Finished updating ant stats in 0.644 seconds
2013-06-28 18:03:17 [DEBUG   ] Finished updating board flags in 2.175 seconds
2013-06-28 18:03:37 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2013-06-28 18:03:39 [DEBUG   ] Got command RPT from MCS: ref #48471
2013-06-28 18:03:39 [DEBUG   ] summary = ERROR
2013-06-28 18:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48471  13 56471 65019345 A  ERRORERROR'
2013-06-28 18:03:39 [DEBUG   ] Got command RPT from MCS: ref #48472
2013-06-28 18:03:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 18:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48472  77 56471 65019346 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 18:03:57 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-28 18:04:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:04:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:04:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:04:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:04:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:04:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:04:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:04:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:04:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:04:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:04:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 18:04:17 [DEBUG   ] Finished updating ant stats in 0.445 seconds
2013-06-28 18:04:17 [DEBUG   ] Finished updating board flags in 2.030 seconds
2013-06-28 18:04:38 [DEBUG   ] Finished updating ant stats in 1.359 seconds
2013-06-28 18:04:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 18:05:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:05:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:05:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:05:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:05:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:05:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:05:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:05:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:05:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:05:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:05:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 18:05:17 [DEBUG   ] Finished updating board flags in 1.955 seconds
2013-06-28 18:05:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 18:05:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 18:05:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 18:06:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:06:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:06:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:06:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:06:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:06:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:06:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:06:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:06:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:06:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:06:17 [DEBUG   ] Finished updating board flags in 1.857 seconds
2013-06-28 18:06:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 18:06:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 18:06:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 18:07:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:07:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:07:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:07:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:07:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:07:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:07:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:07:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:07:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:07:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:07:18 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-28 18:07:18 [DEBUG   ] Finished updating board flags in 2.899 seconds
2013-06-28 18:07:38 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2013-06-28 18:07:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 18:08:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:08:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:08:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:08:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:08:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:08:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:08:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:08:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:08:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:08:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:08:17 [DEBUG   ] Finished updating board flags in 1.665 seconds
2013-06-28 18:08:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 18:08:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 18:08:39 [DEBUG   ] Got command RPT from MCS: ref #48488
2013-06-28 18:08:39 [DEBUG   ] summary = ERROR
2013-06-28 18:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48488  13 56471 65319345 A  ERRORERROR'
2013-06-28 18:08:39 [DEBUG   ] Got command RPT from MCS: ref #48489
2013-06-28 18:08:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 18:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48489  77 56471 65319346 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 18:08:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 18:09:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:09:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:09:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:09:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:09:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:09:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:09:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:09:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:09:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:09:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:09:17 [DEBUG   ] Finished updating board flags in 1.660 seconds
2013-06-28 18:09:18 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-28 18:09:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 18:09:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 18:10:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:10:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:10:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:10:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:10:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:10:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:10:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:10:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:10:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:10:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:10:17 [DEBUG   ] Finished updating board flags in 1.557 seconds
2013-06-28 18:10:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 18:10:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 18:10:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 18:11:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:11:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:11:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:11:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:11:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:11:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:11:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:11:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:11:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:11:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:11:18 [DEBUG   ] Finished updating ant stats in 1.045 seconds
2013-06-28 18:11:18 [DEBUG   ] Finished updating board flags in 2.468 seconds
2013-06-28 18:11:38 [DEBUG   ] Finished updating ant stats in 0.957 seconds
2013-06-28 18:11:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 18:12:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:12:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:12:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:12:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:12:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:12:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:12:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:12:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:12:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:12:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:12:18 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2013-06-28 18:12:18 [DEBUG   ] Finished updating board flags in 2.400 seconds
2013-06-28 18:12:38 [DEBUG   ] Finished updating ant stats in 0.759 seconds
2013-06-28 18:12:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 18:13:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:13:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:13:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:13:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:13:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:13:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:13:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:13:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:13:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:13:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:13:18 [DEBUG   ] Finished updating ant stats in 0.644 seconds
2013-06-28 18:13:18 [DEBUG   ] Finished updating board flags in 2.339 seconds
2013-06-28 18:13:38 [DEBUG   ] Finished updating ant stats in 0.557 seconds
2013-06-28 18:13:39 [DEBUG   ] Got command RPT from MCS: ref #48505
2013-06-28 18:13:39 [DEBUG   ] summary = ERROR
2013-06-28 18:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48505  13 56471 65619349 A  ERRORERROR'
2013-06-28 18:13:39 [DEBUG   ] Got command RPT from MCS: ref #48506
2013-06-28 18:13:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 18:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48506  77 56471 65619350 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 18:13:58 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-28 18:14:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:14:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:14:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:14:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:14:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:14:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:14:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:14:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:14:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:14:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:14:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 18:14:18 [DEBUG   ] Finished updating ant stats in 0.447 seconds
2013-06-28 18:14:18 [DEBUG   ] Finished updating board flags in 2.195 seconds
2013-06-28 18:14:39 [DEBUG   ] Finished updating ant stats in 1.358 seconds
2013-06-28 18:14:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 18:15:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:15:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:15:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:15:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:15:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:15:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:15:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:15:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:15:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:15:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:15:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 18:15:18 [DEBUG   ] Finished updating board flags in 2.270 seconds
2013-06-28 18:15:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 18:15:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 18:15:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 18:16:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:16:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:16:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:16:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:16:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:16:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:16:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:16:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:16:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:16:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:16:18 [DEBUG   ] Finished updating board flags in 1.945 seconds
2013-06-28 18:16:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 18:16:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 18:16:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 18:17:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:17:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:17:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:17:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:17:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:17:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:17:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:17:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:17:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:17:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:17:18 [DEBUG   ] Finished updating board flags in 1.792 seconds
2013-06-28 18:17:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 18:17:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 18:17:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 18:18:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:18:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:18:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:18:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:18:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:18:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:18:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:18:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:18:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:18:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:18:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 18:18:18 [DEBUG   ] Finished updating board flags in 1.609 seconds
2013-06-28 18:18:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 18:18:39 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2013-06-28 18:18:39 [DEBUG   ] Got command RPT from MCS: ref #48522
2013-06-28 18:18:39 [DEBUG   ] summary = ERROR
2013-06-28 18:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48522  13 56471 65919342 A  ERRORERROR'
2013-06-28 18:18:39 [DEBUG   ] Got command RPT from MCS: ref #48523
2013-06-28 18:18:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 18:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48523  77 56471 65919342 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 18:18:59 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-28 18:19:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:19:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:19:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:19:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:19:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:19:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:19:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:19:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:19:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:19:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:19:18 [DEBUG   ] Finished updating board flags in 1.613 seconds
2013-06-28 18:19:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 18:19:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 18:19:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 18:20:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:20:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:20:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:20:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:20:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:20:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:20:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:20:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:20:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:20:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:20:18 [DEBUG   ] Finished updating board flags in 1.630 seconds
2013-06-28 18:20:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-28 18:20:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 18:20:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 18:21:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:21:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:21:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:21:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:21:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:21:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:21:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:21:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:21:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:21:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:21:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 18:21:18 [DEBUG   ] Finished updating board flags in 1.515 seconds
2013-06-28 18:21:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 18:21:39 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-28 18:22:00 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-28 18:22:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:22:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:22:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:22:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:22:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:22:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:22:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:22:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:22:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:22:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:22:18 [DEBUG   ] Finished updating board flags in 1.415 seconds
2013-06-28 18:22:20 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-28 18:22:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 18:23:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 18:23:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:23:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:23:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:23:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:23:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:23:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:23:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:23:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:23:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:23:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:23:18 [DEBUG   ] Finished updating board flags in 1.376 seconds
2013-06-28 18:23:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 18:23:39 [DEBUG   ] Got command RPT from MCS: ref #48539
2013-06-28 18:23:39 [DEBUG   ] summary = ERROR
2013-06-28 18:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48539  13 56471 66219349 A  ERRORERROR'
2013-06-28 18:23:39 [DEBUG   ] Got command RPT from MCS: ref #48540
2013-06-28 18:23:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 18:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48540  77 56471 66219350 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 18:23:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 18:24:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 18:24:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:24:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:24:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:24:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:24:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:24:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:24:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:24:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:24:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:24:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:24:19 [DEBUG   ] Finished updating board flags in 2.309 seconds
2013-06-28 18:24:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 18:24:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 18:25:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 18:25:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:25:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:25:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:25:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:25:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:25:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:25:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:25:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:25:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:25:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:25:19 [DEBUG   ] Finished updating board flags in 2.145 seconds
2013-06-28 18:25:20 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 18:25:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 18:26:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 18:26:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:26:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:26:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:26:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:26:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:26:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:26:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:26:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:26:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:26:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:26:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 18:26:19 [DEBUG   ] Finished updating board flags in 2.038 seconds
2013-06-28 18:26:20 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-28 18:26:40 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 18:27:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 18:27:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:27:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:27:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:27:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:27:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:27:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:27:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:27:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:27:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:27:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:27:19 [DEBUG   ] Finished updating board flags in 2.010 seconds
2013-06-28 18:27:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 18:27:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 18:28:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 18:28:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:28:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:28:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:28:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:28:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:28:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:28:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:28:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:28:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:28:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:28:19 [DEBUG   ] Finished updating board flags in 1.935 seconds
2013-06-28 18:28:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 18:28:39 [DEBUG   ] Got command RPT from MCS: ref #48556
2013-06-28 18:28:39 [DEBUG   ] summary = ERROR
2013-06-28 18:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48556  13 56471 66519349 A  ERRORERROR'
2013-06-28 18:28:39 [DEBUG   ] Got command RPT from MCS: ref #48557
2013-06-28 18:28:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 18:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48557  77 56471 66519350 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 18:28:40 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-28 18:29:00 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 18:29:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:29:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:29:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:29:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:29:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:29:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:29:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:29:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:29:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:29:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:29:19 [DEBUG   ] Finished updating board flags in 1.853 seconds
2013-06-28 18:29:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 18:29:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 18:30:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 18:30:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:30:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:30:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:30:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:30:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:30:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:30:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:30:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:30:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:30:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:30:19 [DEBUG   ] Finished updating board flags in 1.786 seconds
2013-06-28 18:30:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 18:30:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 18:31:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 18:31:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:31:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:31:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:31:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:31:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:31:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:31:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:31:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:31:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:31:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:31:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 18:31:19 [DEBUG   ] Finished updating board flags in 1.630 seconds
2013-06-28 18:31:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 18:31:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 18:32:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 18:32:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:32:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:32:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:32:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:32:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:32:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:32:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:32:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:32:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:32:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:32:19 [DEBUG   ] Finished updating board flags in 1.542 seconds
2013-06-28 18:32:20 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-28 18:32:40 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 18:33:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 18:33:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:33:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:33:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:33:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:33:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:33:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:33:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:33:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:33:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:33:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:33:19 [DEBUG   ] Finished updating board flags in 1.544 seconds
2013-06-28 18:33:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 18:33:39 [DEBUG   ] Got command RPT from MCS: ref #48573
2013-06-28 18:33:39 [DEBUG   ] summary = ERROR
2013-06-28 18:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48573  13 56471 66819350 A  ERRORERROR'
2013-06-28 18:33:39 [DEBUG   ] Got command RPT from MCS: ref #48574
2013-06-28 18:33:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 18:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48574  77 56471 66819350 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 18:33:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 18:34:00 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 18:34:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:34:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:34:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:34:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:34:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:34:20 [DEBUG   ] Finished updating ant stats in 1.052 seconds
2013-06-28 18:34:20 [DEBUG   ] Finished updating board flags in 2.325 seconds
2013-06-28 18:34:40 [DEBUG   ] Finished updating ant stats in 0.951 seconds
2013-06-28 18:35:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 18:35:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:35:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:35:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:35:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:35:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:35:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 18:35:20 [DEBUG   ] Finished updating ant stats in 0.844 seconds
2013-06-28 18:35:20 [DEBUG   ] Finished updating board flags in 2.147 seconds
2013-06-28 18:35:40 [DEBUG   ] Finished updating ant stats in 0.762 seconds
2013-06-28 18:36:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 18:36:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:36:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:36:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:36:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:36:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:36:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:36:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:36:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:36:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:36:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:36:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 18:36:20 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2013-06-28 18:36:20 [DEBUG   ] Finished updating board flags in 2.015 seconds
2013-06-28 18:36:40 [DEBUG   ] Finished updating ant stats in 0.557 seconds
2013-06-28 18:37:01 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-28 18:37:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:37:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:37:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:37:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:37:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:37:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:37:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:37:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:37:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:37:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:37:20 [DEBUG   ] Finished updating board flags in 1.997 seconds
2013-06-28 18:37:21 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-28 18:37:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 18:38:01 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-28 18:38:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:38:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:38:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:38:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:38:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:38:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:38:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:38:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:38:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:38:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:38:20 [DEBUG   ] Finished updating board flags in 1.806 seconds
2013-06-28 18:38:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-28 18:38:39 [DEBUG   ] Got command RPT from MCS: ref #48590
2013-06-28 18:38:39 [DEBUG   ] summary = ERROR
2013-06-28 18:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48590  13 56471 67119353 A  ERRORERROR'
2013-06-28 18:38:39 [DEBUG   ] Got command RPT from MCS: ref #48591
2013-06-28 18:38:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 18:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48591  77 56471 67119354 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 18:38:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 18:39:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-28 18:39:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:39:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:39:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:39:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:39:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:39:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:39:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:39:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:39:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:39:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:39:20 [DEBUG   ] Finished updating board flags in 1.819 seconds
2013-06-28 18:39:21 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-28 18:39:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 18:40:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 18:40:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:40:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:40:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:40:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:40:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:40:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:40:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:40:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:40:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:40:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:40:20 [DEBUG   ] Finished updating board flags in 1.782 seconds
2013-06-28 18:40:21 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2013-06-28 18:40:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 18:41:01 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2013-06-28 18:41:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:41:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:41:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:41:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:41:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:41:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 18:41:20 [DEBUG   ] Finished updating board flags in 1.571 seconds
2013-06-28 18:41:21 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-28 18:41:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-28 18:42:02 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-28 18:42:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:42:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:42:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:42:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:42:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:42:20 [DEBUG   ] Finished updating board flags in 1.395 seconds
2013-06-28 18:42:22 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-28 18:42:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 18:43:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 18:43:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:43:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:43:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:43:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:43:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:43:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:43:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:43:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:43:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:43:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:43:21 [DEBUG   ] Finished updating board flags in 2.236 seconds
2013-06-28 18:43:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 18:43:39 [DEBUG   ] Got command RPT from MCS: ref #48607
2013-06-28 18:43:39 [DEBUG   ] summary = ERROR
2013-06-28 18:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48607  13 56471 67419349 A  ERRORERROR'
2013-06-28 18:43:39 [DEBUG   ] Got command RPT from MCS: ref #48608
2013-06-28 18:43:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 18:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48608  77 56471 67419350 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 18:43:42 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-28 18:44:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 18:44:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:44:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:44:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:44:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:44:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:44:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:44:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:44:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:44:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:44:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:44:21 [DEBUG   ] Finished updating board flags in 2.216 seconds
2013-06-28 18:44:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 18:44:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 18:45:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 18:45:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:45:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:45:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:45:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:45:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:45:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:45:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:45:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:45:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:45:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:45:21 [DEBUG   ] Finished updating board flags in 2.248 seconds
2013-06-28 18:45:22 [DEBUG   ] Finished updating ant stats in 0.993 seconds
2013-06-28 18:45:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 18:46:02 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-28 18:46:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:46:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:46:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:46:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:46:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:46:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:46:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:46:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:46:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:46:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:46:21 [DEBUG   ] Finished updating board flags in 2.128 seconds
2013-06-28 18:46:22 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 18:46:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 18:47:02 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-28 18:47:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:47:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:47:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:47:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:47:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:47:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:47:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:47:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:47:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:47:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:47:21 [DEBUG   ] Finished updating board flags in 2.022 seconds
2013-06-28 18:47:22 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-28 18:47:43 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2013-06-28 18:48:03 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-28 18:48:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:48:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:48:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:48:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:48:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:48:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:48:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:48:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:48:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:48:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:48:21 [DEBUG   ] Finished updating board flags in 1.951 seconds
2013-06-28 18:48:23 [DEBUG   ] Finished updating ant stats in 1.178 seconds
2013-06-28 18:48:39 [DEBUG   ] Got command RPT from MCS: ref #48624
2013-06-28 18:48:39 [DEBUG   ] summary = ERROR
2013-06-28 18:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48624  13 56471 67719359 A  ERRORERROR'
2013-06-28 18:48:39 [DEBUG   ] Got command RPT from MCS: ref #48625
2013-06-28 18:48:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 18:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48625  77 56471 67719359 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 18:48:43 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2013-06-28 18:49:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 18:49:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:49:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:49:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:49:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:49:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:49:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:49:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:49:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:49:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:49:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:49:21 [DEBUG   ] Finished updating board flags in 1.822 seconds
2013-06-28 18:49:23 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-28 18:49:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 18:50:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 18:50:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:50:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:50:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:50:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:50:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:50:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:50:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:50:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:50:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:50:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:50:21 [DEBUG   ] Finished updating board flags in 1.785 seconds
2013-06-28 18:50:23 [DEBUG   ] Finished updating ant stats in 0.573 seconds
2013-06-28 18:50:44 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-28 18:51:04 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-28 18:51:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:51:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:51:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:51:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:51:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:51:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:51:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:51:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:51:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:51:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:51:21 [DEBUG   ] Finished updating board flags in 1.616 seconds
2013-06-28 18:51:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 18:51:44 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 18:52:04 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-28 18:52:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:52:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:52:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:52:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:52:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:52:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:52:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:52:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:52:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:52:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:52:21 [DEBUG   ] Finished updating board flags in 1.589 seconds
2013-06-28 18:52:24 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-28 18:52:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 18:53:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 18:53:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:53:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:53:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:53:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:53:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:53:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:53:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:53:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:53:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:53:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:53:21 [DEBUG   ] Finished updating board flags in 1.411 seconds
2013-06-28 18:53:24 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-28 18:53:39 [DEBUG   ] Got command RPT from MCS: ref #48641
2013-06-28 18:53:39 [DEBUG   ] summary = ERROR
2013-06-28 18:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48641  13 56471 68019357 A  ERRORERROR'
2013-06-28 18:53:39 [DEBUG   ] Got command RPT from MCS: ref #48642
2013-06-28 18:53:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 18:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48642  77 56471 68019358 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 18:53:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 18:54:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 18:54:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:54:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:54:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:54:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:54:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:54:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:54:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:54:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:54:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:54:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:54:21 [DEBUG   ] Finished updating board flags in 1.398 seconds
2013-06-28 18:54:24 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-28 18:54:45 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-28 18:55:05 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-28 18:55:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:55:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:55:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:55:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:55:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:55:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:55:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:55:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:55:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:55:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:55:22 [DEBUG   ] Finished updating board flags in 2.208 seconds
2013-06-28 18:55:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 18:55:45 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-28 18:56:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 18:56:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:56:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:56:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:56:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:56:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:56:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:56:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:56:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:56:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:56:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:56:22 [DEBUG   ] Finished updating board flags in 2.164 seconds
2013-06-28 18:56:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 18:56:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 18:57:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 18:57:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:57:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:57:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:57:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:57:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:57:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:57:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:57:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:57:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:57:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:57:22 [DEBUG   ] Finished updating board flags in 2.020 seconds
2013-06-28 18:57:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 18:57:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 18:58:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 18:58:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:58:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:58:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:58:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:58:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:58:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:58:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:58:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:58:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:58:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:58:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 18:58:22 [DEBUG   ] Finished updating board flags in 1.999 seconds
2013-06-28 18:58:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 18:58:39 [DEBUG   ] Got command RPT from MCS: ref #48658
2013-06-28 18:58:39 [DEBUG   ] summary = ERROR
2013-06-28 18:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48658  13 56471 68319353 A  ERRORERROR'
2013-06-28 18:58:39 [DEBUG   ] Got command RPT from MCS: ref #48659
2013-06-28 18:58:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 18:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48659  77 56471 68319354 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 18:58:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 18:59:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 18:59:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 18:59:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 18:59:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 18:59:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 18:59:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 18:59:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 18:59:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 18:59:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 18:59:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 18:59:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 18:59:22 [DEBUG   ] Finished updating board flags in 1.825 seconds
2013-06-28 18:59:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 18:59:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 19:00:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 19:00:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:00:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:00:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:00:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:00:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:00:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:00:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:00:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:00:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:00:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:00:22 [DEBUG   ] Finished updating board flags in 1.869 seconds
2013-06-28 19:00:25 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-28 19:00:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 19:01:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 19:01:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:01:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:01:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:01:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:01:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:01:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:01:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:01:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:01:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:01:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:01:22 [DEBUG   ] Finished updating board flags in 1.697 seconds
2013-06-28 19:01:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 19:01:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 19:02:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 19:02:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:02:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:02:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:02:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:02:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:02:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:02:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:02:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:02:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:02:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:02:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 19:02:22 [DEBUG   ] Finished updating board flags in 1.645 seconds
2013-06-28 19:02:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 19:02:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 19:03:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 19:03:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:03:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:03:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:03:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:03:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:03:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:03:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:03:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:03:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:03:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:03:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 19:03:22 [DEBUG   ] Finished updating board flags in 1.566 seconds
2013-06-28 19:03:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 19:03:39 [DEBUG   ] Got command RPT from MCS: ref #48675
2013-06-28 19:03:39 [DEBUG   ] summary = ERROR
2013-06-28 19:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48675  13 56471 68619357 A  ERRORERROR'
2013-06-28 19:03:39 [DEBUG   ] Got command RPT from MCS: ref #48676
2013-06-28 19:03:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 19:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48676  77 56471 68619358 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 19:03:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 19:04:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 19:04:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:04:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:04:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:04:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:04:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:04:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:04:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:04:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:04:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:04:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:04:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 19:04:22 [DEBUG   ] Finished updating board flags in 1.430 seconds
2013-06-28 19:04:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 19:04:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 19:05:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 19:05:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:05:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:05:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:05:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:05:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:05:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:05:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:05:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:05:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:05:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:05:22 [DEBUG   ] Finished updating board flags in 1.571 seconds
2013-06-28 19:05:25 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-28 19:05:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 19:06:05 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-28 19:06:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:06:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:06:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:06:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:06:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:06:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:06:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:06:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:06:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:06:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:06:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 19:06:23 [DEBUG   ] Finished updating board flags in 2.346 seconds
2013-06-28 19:06:25 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2013-06-28 19:06:46 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-28 19:07:06 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-28 19:07:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:07:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:07:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:07:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:07:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:07:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:07:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:07:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:07:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:07:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:07:23 [DEBUG   ] Finished updating board flags in 2.059 seconds
2013-06-28 19:07:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 19:07:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 19:08:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 19:08:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:08:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:08:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:08:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:08:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:08:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:08:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:08:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:08:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:08:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:08:23 [DEBUG   ] Finished updating board flags in 2.011 seconds
2013-06-28 19:08:26 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-28 19:08:39 [DEBUG   ] Got command RPT from MCS: ref #48692
2013-06-28 19:08:39 [DEBUG   ] summary = ERROR
2013-06-28 19:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48692  13 56471 68919357 A  ERRORERROR'
2013-06-28 19:08:39 [DEBUG   ] Got command RPT from MCS: ref #48693
2013-06-28 19:08:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 19:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48693  77 56471 68919358 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 19:08:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 19:09:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 19:09:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:09:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:09:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:09:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:09:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:09:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:09:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:09:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:09:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:09:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:09:23 [DEBUG   ] Finished updating board flags in 1.990 seconds
2013-06-28 19:09:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 19:09:46 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-28 19:10:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 19:10:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:10:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:10:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:10:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:10:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:10:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:10:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:10:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:10:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:10:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:10:23 [DEBUG   ] Finished updating board flags in 1.819 seconds
2013-06-28 19:10:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 19:10:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 19:11:06 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-28 19:11:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:11:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:11:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:11:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:11:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:11:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:11:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:11:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:11:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:11:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:11:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 19:11:23 [DEBUG   ] Finished updating board flags in 1.791 seconds
2013-06-28 19:11:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 19:11:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 19:12:06 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-28 19:12:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:12:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:12:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:12:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:12:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:12:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:12:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:12:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:12:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:12:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:12:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 19:12:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 19:12:23 [DEBUG   ] Finished updating board flags in 1.618 seconds
2013-06-28 19:12:27 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-28 19:12:47 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-28 19:13:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 19:13:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:13:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:13:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:13:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:13:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:13:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:13:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:13:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:13:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:13:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:13:23 [DEBUG   ] Finished updating board flags in 1.575 seconds
2013-06-28 19:13:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 19:13:39 [DEBUG   ] Got command RPT from MCS: ref #48709
2013-06-28 19:13:39 [DEBUG   ] summary = ERROR
2013-06-28 19:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48709  13 56471 69219357 A  ERRORERROR'
2013-06-28 19:13:39 [DEBUG   ] Got command RPT from MCS: ref #48710
2013-06-28 19:13:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 19:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48710  77 56471 69219358 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 19:13:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 19:14:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 19:14:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:14:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:14:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:14:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:14:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:14:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:14:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:14:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:14:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:14:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:14:23 [DEBUG   ] Finished updating board flags in 1.461 seconds
2013-06-28 19:14:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 19:14:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 19:15:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 19:15:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:15:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:15:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:15:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:15:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:15:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:15:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:15:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:15:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:15:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:15:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 19:15:23 [DEBUG   ] Finished updating board flags in 1.612 seconds
2013-06-28 19:15:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 19:15:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 19:16:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-28 19:16:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:16:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:16:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:16:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:16:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:16:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 19:16:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 19:16:24 [DEBUG   ] Finished updating board flags in 2.390 seconds
2013-06-28 19:16:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 19:16:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 19:17:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 19:17:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:17:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:17:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:17:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:17:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:17:24 [DEBUG   ] Finished updating board flags in 2.209 seconds
2013-06-28 19:17:27 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-28 19:17:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 19:18:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 19:18:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:18:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:18:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:18:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:18:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:18:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:18:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:18:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:18:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:18:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:18:24 [DEBUG   ] Finished updating board flags in 2.140 seconds
2013-06-28 19:18:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 19:18:39 [DEBUG   ] Got command RPT from MCS: ref #48726
2013-06-28 19:18:39 [DEBUG   ] summary = ERROR
2013-06-28 19:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48726  13 56471 69519357 A  ERRORERROR'
2013-06-28 19:18:39 [DEBUG   ] Got command RPT from MCS: ref #48727
2013-06-28 19:18:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 19:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48727  77 56471 69519358 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 19:18:47 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-28 19:19:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 19:19:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:19:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:19:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:19:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:19:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:19:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:19:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:19:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:19:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:19:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:19:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 19:19:24 [DEBUG   ] Finished updating board flags in 2.031 seconds
2013-06-28 19:19:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 19:19:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 19:20:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 19:20:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:20:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:20:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:20:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:20:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:20:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:20:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:20:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:20:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:20:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:20:24 [DEBUG   ] Finished updating board flags in 2.061 seconds
2013-06-28 19:20:27 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2013-06-28 19:20:47 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-28 19:21:07 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-28 19:21:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:21:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:21:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:21:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:21:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:21:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:21:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:21:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:21:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:21:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:21:24 [DEBUG   ] Finished updating board flags in 1.946 seconds
2013-06-28 19:21:28 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-28 19:21:48 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-28 19:22:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 19:22:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:22:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:22:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:22:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:22:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:22:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:22:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:22:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:22:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:22:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:22:24 [DEBUG   ] Finished updating board flags in 1.776 seconds
2013-06-28 19:22:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 19:22:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 19:23:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 19:23:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:23:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:23:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:23:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:23:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:23:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:23:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:23:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:23:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:23:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:23:24 [DEBUG   ] Finished updating board flags in 1.606 seconds
2013-06-28 19:23:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 19:23:39 [DEBUG   ] Got command RPT from MCS: ref #48743
2013-06-28 19:23:39 [DEBUG   ] summary = ERROR
2013-06-28 19:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48743  13 56471 69819357 A  ERRORERROR'
2013-06-28 19:23:39 [DEBUG   ] Got command RPT from MCS: ref #48744
2013-06-28 19:23:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 19:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48744  77 56471 69819358 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 19:23:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 19:24:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 19:24:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:24:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:24:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:24:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:24:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:24:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:24:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:24:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:24:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:24:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:24:24 [DEBUG   ] Finished updating board flags in 1.591 seconds
2013-06-28 19:24:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 19:24:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 19:25:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 19:25:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:25:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:25:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:25:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:25:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:25:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:25:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:25:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:25:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:25:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:25:24 [DEBUG   ] Finished updating board flags in 1.435 seconds
2013-06-28 19:25:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 19:25:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 19:26:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 19:26:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:26:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:26:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:26:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:26:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:26:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:26:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:26:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:26:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:26:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:26:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 19:26:24 [DEBUG   ] Finished updating board flags in 1.567 seconds
2013-06-28 19:26:28 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-28 19:26:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 19:27:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 19:27:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:27:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:27:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:27:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:27:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:27:25 [DEBUG   ] Finished updating board flags in 2.324 seconds
2013-06-28 19:27:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 19:27:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 19:28:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 19:28:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:28:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:28:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:28:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:28:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:28:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:28:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:28:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:28:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:28:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:28:25 [DEBUG   ] Finished updating board flags in 2.102 seconds
2013-06-28 19:28:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 19:28:39 [DEBUG   ] Got command RPT from MCS: ref #48760
2013-06-28 19:28:39 [DEBUG   ] summary = ERROR
2013-06-28 19:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48760  13 56471 70119365 A  ERRORERROR'
2013-06-28 19:28:39 [DEBUG   ] Got command RPT from MCS: ref #48761
2013-06-28 19:28:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 19:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48761  77 56471 70119366 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 19:28:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 19:29:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 19:29:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:29:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:29:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:29:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:29:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:29:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:29:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:29:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:29:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:29:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:29:25 [DEBUG   ] Finished updating board flags in 2.006 seconds
2013-06-28 19:29:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 19:29:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 19:30:08 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-28 19:30:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:30:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:30:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:30:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:30:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:30:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:30:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:30:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:30:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:30:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:30:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 19:30:25 [DEBUG   ] Finished updating board flags in 2.004 seconds
2013-06-28 19:30:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 19:30:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 19:31:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 19:31:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:31:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:31:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:31:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:31:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:31:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:31:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:31:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:31:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:31:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:31:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 19:31:25 [DEBUG   ] Finished updating board flags in 1.975 seconds
2013-06-28 19:31:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 19:31:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 19:32:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 19:32:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:32:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:32:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:32:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:32:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:32:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:32:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:32:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:32:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:32:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:32:25 [DEBUG   ] Finished updating board flags in 1.830 seconds
2013-06-28 19:32:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 19:32:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 19:33:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 19:33:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:33:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:33:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:33:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:33:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:33:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:33:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:33:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:33:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:33:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:33:25 [DEBUG   ] Finished updating board flags in 1.805 seconds
2013-06-28 19:33:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 19:33:39 [DEBUG   ] Got command RPT from MCS: ref #48777
2013-06-28 19:33:39 [DEBUG   ] summary = ERROR
2013-06-28 19:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48777  13 56471 70419357 A  ERRORERROR'
2013-06-28 19:33:39 [DEBUG   ] Got command RPT from MCS: ref #48778
2013-06-28 19:33:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 19:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48778  77 56471 70419358 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 19:33:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 19:34:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 19:34:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:34:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:34:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:34:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:34:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:34:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:34:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:34:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:34:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:34:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:34:25 [DEBUG   ] Finished updating board flags in 1.890 seconds
2013-06-28 19:34:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-28 19:34:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 19:35:08 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 19:35:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:35:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:35:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:35:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:35:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:35:25 [DEBUG   ] Finished updating board flags in 1.694 seconds
2013-06-28 19:35:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 19:35:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 19:36:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 19:36:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:36:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:36:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:36:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:36:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:36:25 [DEBUG   ] Finished updating board flags in 1.625 seconds
2013-06-28 19:36:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 19:36:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 19:37:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 19:37:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:37:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:37:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:37:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:37:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:37:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:37:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:37:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:37:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:37:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:37:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 19:37:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 19:37:25 [DEBUG   ] Finished updating board flags in 1.577 seconds
2013-06-28 19:37:28 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 19:37:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 19:38:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 19:38:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:38:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:38:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:38:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:38:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:38:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:38:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:38:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:38:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:38:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:38:25 [DEBUG   ] Finished updating board flags in 1.412 seconds
2013-06-28 19:38:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 19:38:39 [DEBUG   ] Got command RPT from MCS: ref #48794
2013-06-28 19:38:39 [DEBUG   ] summary = ERROR
2013-06-28 19:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48794  13 56471 70719369 A  ERRORERROR'
2013-06-28 19:38:39 [DEBUG   ] Got command RPT from MCS: ref #48795
2013-06-28 19:38:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 19:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48795  77 56471 70719370 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 19:38:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 19:39:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 19:39:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:39:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:39:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:39:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:39:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:39:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:39:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:39:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:39:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:39:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:39:25 [DEBUG   ] Finished updating board flags in 1.550 seconds
2013-06-28 19:39:28 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-28 19:39:49 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2013-06-28 19:40:08 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-28 19:40:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:40:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:40:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:40:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:40:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:40:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:40:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:40:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:40:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:40:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:40:26 [DEBUG   ] Finished updating board flags in 2.342 seconds
2013-06-28 19:40:28 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2013-06-28 19:40:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 19:41:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 19:41:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:41:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:41:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:41:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:41:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:41:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:41:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:41:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:41:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:41:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:41:26 [DEBUG   ] Finished updating board flags in 2.093 seconds
2013-06-28 19:41:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 19:41:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 19:42:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 19:42:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:42:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:42:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:42:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:42:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:42:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:42:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:42:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:42:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:42:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:42:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 19:42:26 [DEBUG   ] Finished updating board flags in 2.017 seconds
2013-06-28 19:42:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 19:42:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 19:43:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 19:43:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:43:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:43:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:43:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:43:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:43:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:43:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:43:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:43:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:43:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:43:26 [DEBUG   ] Finished updating board flags in 1.985 seconds
2013-06-28 19:43:29 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2013-06-28 19:43:39 [DEBUG   ] Got command RPT from MCS: ref #48811
2013-06-28 19:43:39 [DEBUG   ] summary = ERROR
2013-06-28 19:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48811  13 56471 71019361 A  ERRORERROR'
2013-06-28 19:43:39 [DEBUG   ] Got command RPT from MCS: ref #48812
2013-06-28 19:43:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 19:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48812  77 56471 71019362 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 19:43:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 19:44:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 19:44:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:44:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:44:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:44:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:44:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:44:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:44:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:44:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:44:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:44:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:44:26 [DEBUG   ] Finished updating board flags in 1.810 seconds
2013-06-28 19:44:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 19:44:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 19:45:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 19:45:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-28 19:45:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-28 19:45:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-28 19:45:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-28 19:45:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-28 19:45:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-28 19:45:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-28 19:45:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-28 19:45:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-28 19:45:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-28 19:45:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 19:45:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 19:45:26 [DEBUG   ] Finished updating board flags in 1.817 seconds
2013-06-28 19:45:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 19:45:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 19:46:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 196000019
2013-06-28 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 196000019
2013-06-28 19:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 196000019
2013-06-28 19:46:26 [DEBUG   ] Finished updating board flags in 1.892 seconds
2013-06-28 19:46:29 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2013-06-28 19:46:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 19:47:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-28 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-28 19:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-28 19:47:26 [DEBUG   ] Finished updating board flags in 1.774 seconds
2013-06-28 19:47:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 19:47:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 19:48:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 19:48:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 19:48:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 19:48:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 19:48:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 19:48:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 19:48:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 19:48:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 19:48:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 19:48:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 19:48:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 19:48:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 19:48:26 [DEBUG   ] Finished updating board flags in 1.566 seconds
2013-06-28 19:48:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 19:48:39 [DEBUG   ] Got command RPT from MCS: ref #48828
2013-06-28 19:48:39 [DEBUG   ] summary = ERROR
2013-06-28 19:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48828  13 56471 71319361 A  ERRORERROR'
2013-06-28 19:48:39 [DEBUG   ] Got command RPT from MCS: ref #48829
2013-06-28 19:48:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 19:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48829  77 56471 71319362 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 19:48:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 19:49:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 19:49:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 19:49:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 19:49:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 19:49:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 19:49:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 19:49:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 19:49:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 19:49:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 19:49:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 19:49:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 19:49:26 [DEBUG   ] Finished updating board flags in 1.426 seconds
2013-06-28 19:49:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 19:49:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 19:50:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 19:50:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 19:50:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 19:50:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 19:50:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 19:50:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 19:50:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 19:50:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 19:50:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 19:50:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 19:50:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 19:50:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 19:50:27 [DEBUG   ] Finished updating board flags in 2.399 seconds
2013-06-28 19:50:29 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-28 19:50:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 19:51:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 19:51:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 19:51:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 19:51:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 19:51:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 19:51:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 19:51:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 19:51:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 19:51:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 19:51:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 19:51:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 19:51:27 [DEBUG   ] Finished updating board flags in 2.139 seconds
2013-06-28 19:51:29 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-28 19:51:50 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-28 19:52:10 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-28 19:52:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 19:52:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 19:52:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 19:52:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 19:52:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 19:52:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 19:52:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 19:52:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 19:52:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 19:52:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 19:52:27 [DEBUG   ] Finished updating board flags in 2.021 seconds
2013-06-28 19:52:30 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 19:52:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 19:53:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 19:53:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 19:53:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 19:53:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 19:53:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 19:53:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 19:53:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 19:53:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 19:53:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 19:53:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 19:53:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 19:53:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 19:53:27 [DEBUG   ] Finished updating board flags in 2.022 seconds
2013-06-28 19:53:30 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-28 19:53:39 [DEBUG   ] Got command RPT from MCS: ref #48845
2013-06-28 19:53:39 [DEBUG   ] summary = ERROR
2013-06-28 19:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48845  13 56471 71619369 A  ERRORERROR'
2013-06-28 19:53:39 [DEBUG   ] Got command RPT from MCS: ref #48846
2013-06-28 19:53:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 19:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48846  77 56471 71619369 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 19:53:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 19:54:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 19:54:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 19:54:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 19:54:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 19:54:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 19:54:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 19:54:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 19:54:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 19:54:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 19:54:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 19:54:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 19:54:27 [DEBUG   ] Finished updating board flags in 1.960 seconds
2013-06-28 19:54:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 19:54:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 19:55:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 19:55:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 19:55:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 19:55:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 19:55:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 19:55:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 19:55:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 19:55:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 19:55:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 19:55:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 19:55:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 19:55:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 19:55:27 [DEBUG   ] Finished updating board flags in 1.823 seconds
2013-06-28 19:55:30 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 19:55:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 19:56:10 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-28 19:56:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 19:56:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 19:56:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 19:56:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 19:56:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 19:56:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 19:56:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 19:56:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 19:56:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 19:56:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 19:56:27 [DEBUG   ] Finished updating board flags in 1.798 seconds
2013-06-28 19:56:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 19:56:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 19:57:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 19:57:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 19:57:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 19:57:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 19:57:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 19:57:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 19:57:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 19:57:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 19:57:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 19:57:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 19:57:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 19:57:27 [DEBUG   ] Finished updating board flags in 1.595 seconds
2013-06-28 19:57:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 19:57:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 19:58:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 19:58:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 19:58:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 19:58:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 19:58:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 19:58:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 19:58:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 19:58:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 19:58:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 19:58:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 19:58:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 19:58:27 [DEBUG   ] Finished updating board flags in 1.474 seconds
2013-06-28 19:58:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 19:58:39 [DEBUG   ] Got command RPT from MCS: ref #48862
2013-06-28 19:58:39 [DEBUG   ] summary = ERROR
2013-06-28 19:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48862  13 56471 71919369 A  ERRORERROR'
2013-06-28 19:58:39 [DEBUG   ] Got command RPT from MCS: ref #48863
2013-06-28 19:58:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 19:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48863  77 56471 71919370 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 19:58:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 19:59:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 19:59:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 19:59:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 19:59:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 19:59:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 19:59:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 19:59:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 19:59:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 19:59:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 19:59:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 19:59:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 19:59:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 19:59:28 [DEBUG   ] Finished updating board flags in 2.433 seconds
2013-06-28 19:59:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 19:59:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 20:00:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 20:00:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:00:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:00:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:00:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:00:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:00:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:00:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:00:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:00:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:00:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:00:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 20:00:28 [DEBUG   ] Finished updating board flags in 2.311 seconds
2013-06-28 20:00:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 20:00:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 20:01:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 20:01:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:01:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:01:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:01:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:01:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:01:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:01:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:01:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:01:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:01:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:01:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 20:01:28 [DEBUG   ] Finished updating board flags in 2.220 seconds
2013-06-28 20:01:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 20:01:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 20:02:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 20:02:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:02:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:02:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:02:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:02:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:02:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:02:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:02:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:02:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:02:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:02:28 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 20:02:28 [DEBUG   ] Finished updating board flags in 2.163 seconds
2013-06-28 20:02:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 20:02:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 20:03:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 20:03:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:03:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:03:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:03:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:03:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:03:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:03:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:03:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:03:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:03:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:03:28 [DEBUG   ] Finished updating board flags in 2.026 seconds
2013-06-28 20:03:30 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-28 20:03:39 [DEBUG   ] Got command RPT from MCS: ref #48879
2013-06-28 20:03:39 [DEBUG   ] summary = ERROR
2013-06-28 20:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48879  13 56471 72219369 A  ERRORERROR'
2013-06-28 20:03:39 [DEBUG   ] Got command RPT from MCS: ref #48880
2013-06-28 20:03:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 20:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48880  77 56471 72219370 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 20:03:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 20:04:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 20:04:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:04:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:04:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:04:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:04:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:04:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:04:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:04:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:04:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:04:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:04:28 [DEBUG   ] Finished updating board flags in 1.979 seconds
2013-06-28 20:04:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 20:04:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 20:05:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 20:05:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:05:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:05:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:05:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:05:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:05:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:05:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:05:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:05:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:05:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:05:28 [DEBUG   ] Finished updating board flags in 1.900 seconds
2013-06-28 20:05:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 20:05:50 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 20:06:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 20:06:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:06:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:06:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:06:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:06:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:06:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:06:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:06:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:06:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:06:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:06:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 20:06:28 [DEBUG   ] Finished updating board flags in 1.822 seconds
2013-06-28 20:06:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 20:06:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 20:07:10 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 20:07:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:07:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:07:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:07:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:07:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:07:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:07:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:07:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:07:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:07:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:07:28 [DEBUG   ] Finished updating board flags in 1.699 seconds
2013-06-28 20:07:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 20:07:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 20:08:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 20:08:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:08:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:08:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:08:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:08:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:08:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:08:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:08:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:08:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:08:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:08:28 [DEBUG   ] Finished updating board flags in 1.620 seconds
2013-06-28 20:08:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 20:08:39 [DEBUG   ] Got command RPT from MCS: ref #48896
2013-06-28 20:08:39 [DEBUG   ] summary = ERROR
2013-06-28 20:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48896  13 56471 72519365 A  ERRORERROR'
2013-06-28 20:08:39 [DEBUG   ] Got command RPT from MCS: ref #48897
2013-06-28 20:08:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 20:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48897  77 56471 72519366 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 20:08:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 20:09:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 20:09:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:09:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:09:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:09:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:09:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:09:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:09:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:09:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:09:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:09:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:09:28 [DEBUG   ] Finished updating board flags in 1.585 seconds
2013-06-28 20:09:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 20:09:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 20:10:10 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 20:10:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:10:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:10:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:10:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:10:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:10:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:10:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:10:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:10:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:10:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:10:28 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 20:10:28 [DEBUG   ] Finished updating board flags in 1.500 seconds
2013-06-28 20:10:30 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2013-06-28 20:10:50 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-28 20:11:11 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-28 20:11:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:11:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:11:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:11:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:11:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:11:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:11:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:11:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:11:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:11:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:11:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 20:11:29 [DEBUG   ] Finished updating board flags in 2.321 seconds
2013-06-28 20:11:31 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-28 20:11:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 20:12:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 20:12:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:12:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:12:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:12:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:12:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:12:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:12:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:12:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:12:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:12:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:12:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 20:12:29 [DEBUG   ] Finished updating board flags in 2.190 seconds
2013-06-28 20:12:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 20:12:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 20:13:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 20:13:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:13:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:13:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:13:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:13:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:13:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-28 20:13:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:13:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:13:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:13:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:13:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:13:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 20:13:29 [DEBUG   ] Finished updating board flags in 2.073 seconds
2013-06-28 20:13:31 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-28 20:13:39 [DEBUG   ] Got command RPT from MCS: ref #48913
2013-06-28 20:13:39 [DEBUG   ] summary = ERROR
2013-06-28 20:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48913  13 56471 72819369 A  ERRORERROR'
2013-06-28 20:13:39 [DEBUG   ] Got command RPT from MCS: ref #48914
2013-06-28 20:13:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 20:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48914  77 56471 72819370 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 20:13:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 20:14:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 20:14:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:14:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:14:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:14:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:14:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:14:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:14:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:14:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:14:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:14:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:14:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 20:14:29 [DEBUG   ] Finished updating board flags in 1.911 seconds
2013-06-28 20:14:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 20:14:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 20:15:11 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 20:15:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:15:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:15:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:15:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:15:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:15:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:15:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:15:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:15:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:15:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:15:29 [DEBUG   ] Finished updating board flags in 1.828 seconds
2013-06-28 20:15:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 20:15:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 20:16:11 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 20:16:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:16:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:16:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:16:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:16:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:16:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:16:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:16:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:16:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:16:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:16:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-28 20:16:29 [DEBUG   ] Finished updating board flags in 1.839 seconds
2013-06-28 20:16:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 20:16:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 20:17:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 20:17:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:17:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:17:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:17:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:17:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:17:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:17:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:17:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:17:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:17:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:17:29 [DEBUG   ] Finished updating board flags in 1.749 seconds
2013-06-28 20:17:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 20:17:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 20:18:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 20:18:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:18:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:18:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:18:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:18:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:18:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:18:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:18:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:18:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:18:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:18:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 20:18:29 [DEBUG   ] Finished updating board flags in 1.661 seconds
2013-06-28 20:18:31 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-28 20:18:39 [DEBUG   ] Got command RPT from MCS: ref #48930
2013-06-28 20:18:39 [DEBUG   ] summary = ERROR
2013-06-28 20:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48930  13 56471 73119373 A  ERRORERROR'
2013-06-28 20:18:39 [DEBUG   ] Got command RPT from MCS: ref #48931
2013-06-28 20:18:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 20:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48931  77 56471 73119374 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 20:18:51 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-28 20:19:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 20:19:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:19:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:19:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:19:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:19:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:19:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-28 20:19:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:19:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:19:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:19:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:19:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:19:29 [DEBUG   ] Finished updating board flags in 1.528 seconds
2013-06-28 20:19:31 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 20:19:51 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2013-06-28 20:20:11 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2013-06-28 20:20:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:20:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:20:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:20:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:20:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:20:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:20:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:20:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:20:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:20:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:20:29 [DEBUG   ] Finished updating board flags in 1.422 seconds
2013-06-28 20:20:32 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-28 20:20:52 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-28 20:21:12 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 20:21:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:21:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:21:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:21:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:21:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:21:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:21:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:21:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:21:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:21:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:21:29 [DEBUG   ] Finished updating board flags in 1.405 seconds
2013-06-28 20:21:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 20:21:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 20:22:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 20:22:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:22:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:22:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:22:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:22:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:22:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:22:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:22:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:22:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:22:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:22:29 [DEBUG   ] Finished updating board flags in 1.425 seconds
2013-06-28 20:22:32 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2013-06-28 20:22:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 20:23:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 20:23:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:23:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:23:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:23:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:23:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:23:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:23:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:23:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:23:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:23:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:23:29 [DEBUG   ] Finished updating board flags in 1.433 seconds
2013-06-28 20:23:32 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-28 20:23:39 [DEBUG   ] Got command RPT from MCS: ref #48947
2013-06-28 20:23:39 [DEBUG   ] summary = ERROR
2013-06-28 20:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48947  13 56471 73419369 A  ERRORERROR'
2013-06-28 20:23:39 [DEBUG   ] Got command RPT from MCS: ref #48948
2013-06-28 20:23:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 20:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48948  77 56471 73419370 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 20:23:52 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 20:24:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 20:24:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:24:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:24:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:24:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:24:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:24:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:24:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:24:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:24:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:24:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:24:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 20:24:30 [DEBUG   ] Finished updating board flags in 2.359 seconds
2013-06-28 20:24:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 20:24:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 20:25:12 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 20:25:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:25:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:25:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:25:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:25:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:25:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:25:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:25:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:25:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:25:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:25:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-28 20:25:30 [DEBUG   ] Finished updating board flags in 2.165 seconds
2013-06-28 20:25:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 20:25:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 20:26:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 20:26:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:26:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:26:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:26:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:26:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:26:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:26:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:26:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:26:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:26:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:26:30 [DEBUG   ] Finished updating board flags in 2.060 seconds
2013-06-28 20:26:32 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-28 20:26:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 20:27:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 20:27:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:27:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:27:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:27:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:27:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:27:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:27:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:27:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:27:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:27:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:27:30 [DEBUG   ] Finished updating board flags in 2.010 seconds
2013-06-28 20:27:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 20:27:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 20:28:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 20:28:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:28:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:28:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:28:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:28:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:28:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-28 20:28:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:28:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:28:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:28:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:28:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:28:30 [DEBUG   ] Finished updating board flags in 1.910 seconds
2013-06-28 20:28:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 20:28:39 [DEBUG   ] Got command RPT from MCS: ref #48964
2013-06-28 20:28:39 [DEBUG   ] summary = ERROR
2013-06-28 20:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48964  13 56471 73719377 A  ERRORERROR'
2013-06-28 20:28:39 [DEBUG   ] Got command RPT from MCS: ref #48965
2013-06-28 20:28:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 20:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48965  77 56471 73719378 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 20:28:52 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-28 20:29:12 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-28 20:29:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:29:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:29:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:29:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:29:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:29:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:29:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:29:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:29:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:29:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:29:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 20:29:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 20:29:30 [DEBUG   ] Finished updating board flags in 1.820 seconds
2013-06-28 20:29:33 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-28 20:29:53 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-28 20:30:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 20:30:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:30:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:30:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:30:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:30:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:30:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:30:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:30:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:30:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:30:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:30:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-28 20:30:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 20:30:30 [DEBUG   ] Finished updating board flags in 1.796 seconds
2013-06-28 20:30:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 20:30:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 20:31:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 20:31:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:31:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:31:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:31:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:31:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:31:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:31:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:31:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:31:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:31:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:31:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 20:31:30 [DEBUG   ] Finished updating board flags in 1.645 seconds
2013-06-28 20:31:33 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-28 20:31:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 20:32:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 20:32:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:32:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:32:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:32:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:32:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:32:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:32:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:32:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:32:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:32:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:32:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-28 20:32:30 [DEBUG   ] Finished updating board flags in 1.563 seconds
2013-06-28 20:32:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 20:32:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 20:33:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 20:33:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:33:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:33:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:33:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:33:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:33:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:33:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:33:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:33:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:33:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:33:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 20:33:30 [DEBUG   ] Finished updating board flags in 1.400 seconds
2013-06-28 20:33:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 20:33:39 [DEBUG   ] Got command RPT from MCS: ref #48981
2013-06-28 20:33:39 [DEBUG   ] summary = ERROR
2013-06-28 20:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48981  13 56471 74019377 A  ERRORERROR'
2013-06-28 20:33:39 [DEBUG   ] Got command RPT from MCS: ref #48982
2013-06-28 20:33:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 20:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48982  77 56471 74019378 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 20:33:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 20:34:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 20:34:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:34:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:34:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:34:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:34:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:34:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:34:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:34:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:34:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:34:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:34:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 20:34:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 20:34:30 [DEBUG   ] Finished updating board flags in 1.435 seconds
2013-06-28 20:34:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 20:34:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 20:35:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 20:35:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:35:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:35:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:35:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:35:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:35:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:35:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:35:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:35:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:35:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:35:30 [DEBUG   ] Finished updating board flags in 1.465 seconds
2013-06-28 20:35:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 20:35:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 20:36:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 20:36:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:36:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:36:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:36:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:36:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:36:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:36:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:36:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:36:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:36:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:36:31 [DEBUG   ] Finished updating board flags in 2.422 seconds
2013-06-28 20:36:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 20:36:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 20:37:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 20:37:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:37:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:37:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:37:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:37:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:37:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:37:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:37:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:37:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:37:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:37:31 [DEBUG   ] Finished updating board flags in 2.291 seconds
2013-06-28 20:37:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 20:37:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 20:38:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 20:38:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:38:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:38:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:38:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:38:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:38:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:38:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:38:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:38:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:38:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:38:31 [DEBUG   ] Finished updating board flags in 2.228 seconds
2013-06-28 20:38:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 20:38:39 [DEBUG   ] Got command RPT from MCS: ref #48998
2013-06-28 20:38:39 [DEBUG   ] summary = ERROR
2013-06-28 20:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48998  13 56471 74319373 A  ERRORERROR'
2013-06-28 20:38:39 [DEBUG   ] Got command RPT from MCS: ref #48999
2013-06-28 20:38:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 20:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    48999  77 56471 74319374 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 20:38:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 20:39:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 20:39:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:39:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:39:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:39:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:39:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:39:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:39:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:39:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:39:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:39:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:39:31 [DEBUG   ] Finished updating board flags in 2.175 seconds
2013-06-28 20:39:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 20:39:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 20:40:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 20:40:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:40:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:40:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:40:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:40:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:40:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:40:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:40:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:40:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:40:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:40:31 [DEBUG   ] Finished updating board flags in 2.027 seconds
2013-06-28 20:40:33 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-28 20:40:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 20:41:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 20:41:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:41:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:41:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:41:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:41:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:41:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:41:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:41:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:41:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:41:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:41:31 [DEBUG   ] Finished updating board flags in 1.975 seconds
2013-06-28 20:41:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 20:41:53 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-28 20:42:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 20:42:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:42:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:42:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:42:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:42:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:42:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:42:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:42:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:42:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:42:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:42:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 20:42:31 [DEBUG   ] Finished updating board flags in 1.813 seconds
2013-06-28 20:42:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 20:42:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 20:43:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 20:43:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:43:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:43:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:43:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:43:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:43:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:43:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:43:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:43:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:43:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:43:31 [DEBUG   ] Finished updating board flags in 1.908 seconds
2013-06-28 20:43:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 20:43:39 [DEBUG   ] Got command RPT from MCS: ref #49015
2013-06-28 20:43:39 [DEBUG   ] summary = ERROR
2013-06-28 20:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49015  13 56471 74619373 A  ERRORERROR'
2013-06-28 20:43:39 [DEBUG   ] Got command RPT from MCS: ref #49016
2013-06-28 20:43:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 20:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49016  77 56471 74619374 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 20:43:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 20:44:13 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 20:44:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:44:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:44:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:44:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:44:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:44:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:44:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:44:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:44:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:44:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:44:31 [DEBUG   ] Finished updating board flags in 1.680 seconds
2013-06-28 20:44:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 20:44:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 20:45:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 20:45:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:45:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:45:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:45:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:45:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:45:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:45:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:45:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:45:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:45:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:45:31 [DEBUG   ] Finished updating board flags in 1.620 seconds
2013-06-28 20:45:33 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2013-06-28 20:45:54 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2013-06-28 20:46:13 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2013-06-28 20:46:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:46:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:46:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:46:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:46:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:46:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:46:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:46:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:46:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:46:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:46:31 [DEBUG   ] Finished updating board flags in 1.586 seconds
2013-06-28 20:46:34 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-28 20:46:54 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-28 20:47:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 20:47:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:47:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:47:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:47:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:47:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:47:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:47:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:47:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:47:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:47:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:47:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 20:47:31 [DEBUG   ] Finished updating board flags in 1.412 seconds
2013-06-28 20:47:34 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 20:47:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 20:48:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 20:48:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:48:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:48:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:48:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:48:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:48:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:48:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:48:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:48:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:48:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:48:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 20:48:31 [DEBUG   ] Finished updating board flags in 1.426 seconds
2013-06-28 20:48:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 20:48:39 [DEBUG   ] Got command RPT from MCS: ref #49032
2013-06-28 20:48:39 [DEBUG   ] summary = ERROR
2013-06-28 20:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49032  13 56471 74919381 A  ERRORERROR'
2013-06-28 20:48:39 [DEBUG   ] Got command RPT from MCS: ref #49033
2013-06-28 20:48:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 20:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49033  77 56471 74919382 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 20:48:54 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 20:49:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 20:49:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:49:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:49:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:49:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:49:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:49:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:49:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:49:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:49:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:49:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:49:31 [DEBUG   ] Finished updating board flags in 1.428 seconds
2013-06-28 20:49:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 20:49:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 20:50:14 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-28 20:50:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:50:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:50:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:50:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:50:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:50:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:50:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:50:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:50:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:50:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:50:32 [DEBUG   ] Finished updating board flags in 2.367 seconds
2013-06-28 20:50:34 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2013-06-28 20:50:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 20:51:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 20:51:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:51:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:51:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:51:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:51:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:51:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:51:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:51:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:51:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:51:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:51:32 [DEBUG   ] Finished updating board flags in 2.183 seconds
2013-06-28 20:51:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 20:51:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 20:52:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 20:52:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:52:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:52:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:52:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:52:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:52:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:52:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:52:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:52:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:52:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:52:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 20:52:32 [DEBUG   ] Finished updating board flags in 2.054 seconds
2013-06-28 20:52:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 20:52:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 20:53:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 20:53:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:53:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:53:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:53:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:53:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:53:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:53:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:53:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:53:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:53:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:53:32 [DEBUG   ] Finished updating board flags in 2.064 seconds
2013-06-28 20:53:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 20:53:39 [DEBUG   ] Got command RPT from MCS: ref #49049
2013-06-28 20:53:39 [DEBUG   ] summary = ERROR
2013-06-28 20:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49049  13 56471 75219378 A  ERRORERROR'
2013-06-28 20:53:39 [DEBUG   ] Got command RPT from MCS: ref #49050
2013-06-28 20:53:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 20:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49050  77 56471 75219378 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 20:53:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 20:54:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 20:54:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:54:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:54:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:54:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:54:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:54:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:54:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:54:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:54:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:54:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:54:32 [DEBUG   ] Finished updating board flags in 1.907 seconds
2013-06-28 20:54:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 20:54:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 20:55:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 20:55:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:55:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:55:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:55:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:55:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:55:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:55:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:55:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:55:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:55:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:55:32 [DEBUG   ] Finished updating board flags in 1.829 seconds
2013-06-28 20:55:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 20:55:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 20:56:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 20:56:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:56:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:56:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:56:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:56:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:56:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:56:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:56:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:56:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:56:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:56:32 [DEBUG   ] Finished updating board flags in 1.761 seconds
2013-06-28 20:56:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 20:56:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 20:57:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 20:57:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:57:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:57:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:57:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:57:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:57:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:57:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:57:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:57:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:57:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:57:32 [DEBUG   ] Finished updating board flags in 1.618 seconds
2013-06-28 20:57:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 20:57:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 20:58:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 20:58:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:58:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:58:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:58:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:58:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:58:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:58:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:58:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:58:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:58:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:58:32 [DEBUG   ] Finished updating board flags in 1.629 seconds
2013-06-28 20:58:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 20:58:39 [DEBUG   ] Got command RPT from MCS: ref #49066
2013-06-28 20:58:39 [DEBUG   ] summary = ERROR
2013-06-28 20:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49066  13 56471 75519377 A  ERRORERROR'
2013-06-28 20:58:39 [DEBUG   ] Got command RPT from MCS: ref #49067
2013-06-28 20:58:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 20:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49067  77 56471 75519378 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 20:58:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 20:59:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 20:59:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 20:59:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 20:59:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 20:59:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 20:59:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 20:59:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 20:59:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 20:59:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 20:59:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 20:59:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 20:59:32 [DEBUG   ] Finished updating board flags in 1.651 seconds
2013-06-28 20:59:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 20:59:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 21:00:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 21:00:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:00:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:00:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:00:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:00:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:00:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:00:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:00:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:00:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:00:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:00:32 [DEBUG   ] Finished updating board flags in 1.529 seconds
2013-06-28 21:00:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 21:00:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 21:01:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 21:01:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:01:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:01:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:01:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:01:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:01:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:01:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:01:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:01:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:01:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:01:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 21:01:32 [DEBUG   ] Finished updating board flags in 1.516 seconds
2013-06-28 21:01:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 21:01:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 21:02:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 21:02:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:02:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:02:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:02:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:02:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:02:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:02:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:02:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:02:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:02:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:02:33 [DEBUG   ] Finished updating board flags in 2.343 seconds
2013-06-28 21:02:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 21:02:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 21:03:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 21:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:03:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:03:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:03:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:03:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:03:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:03:33 [DEBUG   ] Finished updating board flags in 2.169 seconds
2013-06-28 21:03:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 21:03:39 [DEBUG   ] Got command RPT from MCS: ref #49083
2013-06-28 21:03:39 [DEBUG   ] summary = ERROR
2013-06-28 21:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49083  13 56471 75819377 A  ERRORERROR'
2013-06-28 21:03:39 [DEBUG   ] Got command RPT from MCS: ref #49084
2013-06-28 21:03:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 21:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49084  77 56471 75819378 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 21:03:54 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-28 21:04:14 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 21:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:04:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:04:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:04:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:04:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:04:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:04:33 [DEBUG   ] Finished updating board flags in 1.991 seconds
2013-06-28 21:04:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 21:04:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 21:05:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 21:05:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:05:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:05:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:05:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:05:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:05:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:05:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:05:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:05:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:05:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:05:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 21:05:33 [DEBUG   ] Finished updating board flags in 1.867 seconds
2013-06-28 21:05:34 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 21:05:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 21:06:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 21:06:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:06:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:06:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:06:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:06:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:06:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:06:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:06:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:06:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:06:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:06:33 [DEBUG   ] Finished updating board flags in 1.815 seconds
2013-06-28 21:06:34 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-28 21:06:55 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-28 21:07:15 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-28 21:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:07:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:07:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:07:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:07:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:07:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:07:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 21:07:33 [DEBUG   ] Finished updating board flags in 1.687 seconds
2013-06-28 21:07:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 21:07:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 21:08:15 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-28 21:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:08:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:08:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:08:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:08:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:08:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:08:33 [DEBUG   ] Finished updating board flags in 1.618 seconds
2013-06-28 21:08:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 21:08:39 [DEBUG   ] Got command RPT from MCS: ref #49144
2013-06-28 21:08:39 [DEBUG   ] summary = ERROR
2013-06-28 21:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49144  13 56471 76119381 A  ERRORERROR'
2013-06-28 21:08:39 [DEBUG   ] Got command RPT from MCS: ref #49145
2013-06-28 21:08:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 21:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49145  77 56471 76119382 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 21:08:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 21:09:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 21:09:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:09:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:09:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:09:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:09:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:09:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:09:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:09:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:09:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:09:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:09:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 21:09:33 [DEBUG   ] Finished updating board flags in 1.588 seconds
2013-06-28 21:09:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 21:09:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 21:10:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 21:10:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:10:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:10:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:10:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:10:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:10:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:10:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:10:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:10:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:10:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:10:33 [DEBUG   ] Finished updating board flags in 1.426 seconds
2013-06-28 21:10:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 21:10:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 21:11:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 21:11:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:11:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:11:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:11:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:11:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:11:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:11:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:11:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:11:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:11:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:11:33 [DEBUG   ] Finished updating board flags in 1.475 seconds
2013-06-28 21:11:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 21:11:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 21:12:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 21:12:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:12:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:12:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:12:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:12:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:12:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:12:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:12:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:12:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:12:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:12:34 [DEBUG   ] Finished updating board flags in 2.371 seconds
2013-06-28 21:12:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 21:12:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 21:13:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 21:13:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:13:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:13:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:13:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:13:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:13:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:13:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:13:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:13:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:13:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:13:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 21:13:34 [DEBUG   ] Finished updating board flags in 2.250 seconds
2013-06-28 21:13:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 21:13:39 [DEBUG   ] Got command RPT from MCS: ref #49192
2013-06-28 21:13:39 [DEBUG   ] summary = ERROR
2013-06-28 21:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49192  13 56471 76419377 A  ERRORERROR'
2013-06-28 21:13:39 [DEBUG   ] Got command RPT from MCS: ref #49193
2013-06-28 21:13:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 21:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49193  77 56471 76419378 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 21:13:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 21:14:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 21:14:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:14:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:14:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:14:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:14:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:14:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:14:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:14:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:14:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:14:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:14:34 [DEBUG   ] Finished updating board flags in 2.164 seconds
2013-06-28 21:14:35 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-28 21:14:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 21:15:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 21:15:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:15:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:15:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:15:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:15:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:15:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:15:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:15:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:15:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:15:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:15:35 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-28 21:15:35 [DEBUG   ] Finished updating board flags in 2.708 seconds
2013-06-28 21:15:55 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2013-06-28 21:16:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 21:16:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:16:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:16:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:16:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:16:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:16:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:16:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:16:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:16:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:16:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:16:34 [DEBUG   ] Finished updating board flags in 1.854 seconds
2013-06-28 21:16:35 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-28 21:16:56 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-28 21:17:16 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-28 21:17:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:17:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:17:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:17:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:17:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:17:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:17:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:17:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:17:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:17:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:17:34 [DEBUG   ] Finished updating board flags in 1.771 seconds
2013-06-28 21:17:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 21:17:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 21:18:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 21:18:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:18:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:18:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:18:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:18:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:18:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:18:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:18:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:18:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:18:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:18:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 21:18:34 [DEBUG   ] Finished updating board flags in 1.629 seconds
2013-06-28 21:18:36 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-28 21:18:39 [DEBUG   ] Got command RPT from MCS: ref #49209
2013-06-28 21:18:39 [DEBUG   ] summary = ERROR
2013-06-28 21:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49209  13 56471 76719381 A  ERRORERROR'
2013-06-28 21:18:39 [DEBUG   ] Got command RPT from MCS: ref #49210
2013-06-28 21:18:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 21:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49210  77 56471 76719382 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 21:18:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 21:19:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 21:19:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:19:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:19:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:19:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:19:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:19:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:19:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:19:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:19:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:19:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:19:34 [DEBUG   ] Finished updating board flags in 1.571 seconds
2013-06-28 21:19:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 21:19:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 21:20:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 21:20:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:20:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:20:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:20:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:20:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:20:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:20:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:20:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:20:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:20:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:20:34 [DEBUG   ] Finished updating board flags in 1.423 seconds
2013-06-28 21:20:36 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-28 21:20:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 21:21:16 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-28 21:21:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:21:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:21:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:21:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:21:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:21:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:21:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:21:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:21:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:21:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:21:34 [DEBUG   ] Finished updating board flags in 1.409 seconds
2013-06-28 21:21:36 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 21:21:56 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-28 21:22:17 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-28 21:22:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:22:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:22:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:22:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:22:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:22:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:22:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:22:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:22:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:22:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:22:34 [DEBUG   ] Finished updating board flags in 1.379 seconds
2013-06-28 21:22:37 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-28 21:22:57 [DEBUG   ] Finished updating ant stats in 1.185 seconds
2013-06-28 21:23:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 21:23:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:23:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:23:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:23:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:23:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:23:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:23:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:23:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:23:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:23:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:23:35 [DEBUG   ] Finished updating board flags in 2.216 seconds
2013-06-28 21:23:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 21:23:39 [DEBUG   ] Got command RPT from MCS: ref #49226
2013-06-28 21:23:39 [DEBUG   ] summary = ERROR
2013-06-28 21:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49226  13 56471 77019389 A  ERRORERROR'
2013-06-28 21:23:39 [DEBUG   ] Got command RPT from MCS: ref #49227
2013-06-28 21:23:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 21:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49227  77 56471 77019390 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 21:23:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 21:24:17 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 21:24:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:24:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:24:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:24:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:24:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:24:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:24:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:24:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:24:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:24:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:24:35 [DEBUG   ] Finished updating board flags in 2.267 seconds
2013-06-28 21:24:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 21:24:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 21:25:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 21:25:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:25:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:25:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:25:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:25:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:25:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:25:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:25:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:25:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:25:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:25:35 [DEBUG   ] Finished updating board flags in 2.233 seconds
2013-06-28 21:25:37 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 21:25:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 21:26:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 21:26:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:26:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:26:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:26:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:26:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:26:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:26:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:26:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:26:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:26:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:26:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 21:26:35 [DEBUG   ] Finished updating board flags in 2.102 seconds
2013-06-28 21:26:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 21:26:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 21:27:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 21:27:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:27:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:27:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:27:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:27:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:27:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:27:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:27:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:27:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:27:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:27:35 [DEBUG   ] Finished updating board flags in 2.049 seconds
2013-06-28 21:27:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 21:27:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 21:28:17 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2013-06-28 21:28:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:28:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:28:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:28:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:28:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:28:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:28:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:28:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:28:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:28:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:28:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 21:28:35 [DEBUG   ] Finished updating board flags in 1.956 seconds
2013-06-28 21:28:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 21:28:39 [DEBUG   ] Got command RPT from MCS: ref #49243
2013-06-28 21:28:39 [DEBUG   ] summary = ERROR
2013-06-28 21:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49243  13 56471 77319385 A  ERRORERROR'
2013-06-28 21:28:39 [DEBUG   ] Got command RPT from MCS: ref #49244
2013-06-28 21:28:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 21:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49244  77 56471 77319386 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 21:28:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 21:29:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 21:29:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:29:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:29:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:29:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:29:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:29:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:29:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:29:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:29:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:29:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:29:35 [DEBUG   ] Finished updating board flags in 1.806 seconds
2013-06-28 21:29:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 21:29:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 21:30:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 21:30:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:30:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:30:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:30:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:30:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:30:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:30:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:30:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:30:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:30:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:30:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 21:30:35 [DEBUG   ] Finished updating board flags in 1.813 seconds
2013-06-28 21:30:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 21:30:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 21:31:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 21:31:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:31:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:31:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:31:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:31:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:31:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:31:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:31:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:31:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:31:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:31:35 [DEBUG   ] Finished updating board flags in 1.846 seconds
2013-06-28 21:31:37 [DEBUG   ] Finished updating ant stats in 0.779 seconds
2013-06-28 21:31:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 21:32:17 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 21:32:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:32:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:32:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:32:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:32:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:32:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:32:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:32:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:32:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:32:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:32:35 [DEBUG   ] Finished updating board flags in 1.813 seconds
2013-06-28 21:32:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 21:32:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 21:33:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 21:33:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:33:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:33:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:33:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:33:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:33:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:33:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:33:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:33:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:33:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:33:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 21:33:35 [DEBUG   ] Finished updating board flags in 1.839 seconds
2013-06-28 21:33:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 21:33:39 [DEBUG   ] Got command RPT from MCS: ref #49260
2013-06-28 21:33:39 [DEBUG   ] summary = ERROR
2013-06-28 21:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49260  13 56471 77619389 A  ERRORERROR'
2013-06-28 21:33:39 [DEBUG   ] Got command RPT from MCS: ref #49261
2013-06-28 21:33:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 21:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49261  77 56471 77619390 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 21:33:57 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 21:34:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 21:34:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:34:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:34:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:34:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:34:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:34:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:34:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:34:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:34:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:34:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:34:35 [DEBUG   ] Finished updating board flags in 1.680 seconds
2013-06-28 21:34:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 21:34:57 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 21:35:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 21:35:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:35:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:35:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:35:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:35:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:35:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:35:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:35:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:35:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:35:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:35:35 [DEBUG   ] Finished updating board flags in 1.621 seconds
2013-06-28 21:35:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 21:35:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 21:36:17 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 21:36:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:36:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:36:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:36:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:36:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:36:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:36:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:36:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:36:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:36:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:36:35 [DEBUG   ] Finished updating board flags in 1.578 seconds
2013-06-28 21:36:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 21:36:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 21:37:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 21:37:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:37:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:37:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:37:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:37:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:37:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:37:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:37:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:37:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:37:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:37:35 [DEBUG   ] Finished updating board flags in 1.459 seconds
2013-06-28 21:37:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 21:37:57 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 21:38:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 21:38:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:38:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:38:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:38:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:38:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:38:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:38:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:38:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:38:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:38:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:38:35 [DEBUG   ] Finished updating board flags in 1.528 seconds
2013-06-28 21:38:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 21:38:39 [DEBUG   ] Got command RPT from MCS: ref #49277
2013-06-28 21:38:39 [DEBUG   ] summary = ERROR
2013-06-28 21:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49277  13 56471 77919393 A  ERRORERROR'
2013-06-28 21:38:39 [DEBUG   ] Got command RPT from MCS: ref #49278
2013-06-28 21:38:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 21:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49278  77 56471 77919394 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 21:38:57 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 21:39:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 21:39:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:39:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:39:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:39:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:39:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:39:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:39:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:39:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:39:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:39:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:39:36 [DEBUG   ] Finished updating board flags in 2.387 seconds
2013-06-28 21:39:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 21:39:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 21:40:17 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 21:40:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:40:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:40:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:40:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:40:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:40:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:40:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:40:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:40:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:40:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:40:36 [DEBUG   ] Finished updating board flags in 2.214 seconds
2013-06-28 21:40:37 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-28 21:40:57 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-28 21:41:17 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-28 21:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:41:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:41:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:41:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:41:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:41:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:41:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 21:41:36 [DEBUG   ] Finished updating board flags in 2.031 seconds
2013-06-28 21:41:38 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-28 21:41:58 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2013-06-28 21:42:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 21:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:42:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:42:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:42:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:42:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:42:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:42:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 21:42:36 [DEBUG   ] Finished updating board flags in 2.008 seconds
2013-06-28 21:42:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 21:42:58 [DEBUG   ] Finished updating ant stats in 0.978 seconds
2013-06-28 21:43:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 21:43:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:43:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:43:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:43:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:43:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:43:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:43:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:43:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:43:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:43:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:43:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 21:43:36 [DEBUG   ] Finished updating board flags in 2.006 seconds
2013-06-28 21:43:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 21:43:39 [DEBUG   ] Got command RPT from MCS: ref #49294
2013-06-28 21:43:39 [DEBUG   ] summary = ERROR
2013-06-28 21:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49294  13 56471 78219389 A  ERRORERROR'
2013-06-28 21:43:39 [DEBUG   ] Got command RPT from MCS: ref #49295
2013-06-28 21:43:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 21:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49295  77 56471 78219390 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 21:43:58 [DEBUG   ] Finished updating ant stats in 0.790 seconds
2013-06-28 21:44:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 21:44:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:44:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:44:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:44:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:44:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:44:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:44:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:44:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:44:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:44:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:44:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 21:44:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 21:44:36 [DEBUG   ] Finished updating board flags in 1.987 seconds
2013-06-28 21:44:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 21:44:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 21:45:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 21:45:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:45:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:45:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:45:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:45:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:45:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:45:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:45:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:45:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:45:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:45:36 [DEBUG   ] Finished updating board flags in 1.811 seconds
2013-06-28 21:45:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 21:45:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 21:46:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 21:46:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:46:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:46:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:46:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:46:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:46:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:46:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:46:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:46:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:46:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:46:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 21:46:36 [DEBUG   ] Finished updating board flags in 1.824 seconds
2013-06-28 21:46:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 21:46:58 [DEBUG   ] Finished updating ant stats in 0.585 seconds
2013-06-28 21:47:19 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-28 21:47:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:47:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:47:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:47:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:47:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:47:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:47:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:47:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:47:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:47:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:47:36 [DEBUG   ] Finished updating board flags in 1.767 seconds
2013-06-28 21:47:39 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-28 21:47:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 21:48:19 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2013-06-28 21:48:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:48:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:48:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:48:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:48:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:48:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:48:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:48:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:48:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:48:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:48:36 [DEBUG   ] Finished updating board flags in 1.621 seconds
2013-06-28 21:48:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 21:48:39 [DEBUG   ] Got command RPT from MCS: ref #49311
2013-06-28 21:48:39 [DEBUG   ] summary = ERROR
2013-06-28 21:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49311  13 56471 78519389 A  ERRORERROR'
2013-06-28 21:48:39 [DEBUG   ] Got command RPT from MCS: ref #49312
2013-06-28 21:48:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 21:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49312  77 56471 78519390 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 21:48:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 21:49:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 21:49:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:49:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:49:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:49:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:49:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:49:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:49:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:49:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:49:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:49:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:49:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 21:49:36 [DEBUG   ] Finished updating board flags in 1.580 seconds
2013-06-28 21:49:39 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-28 21:49:59 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-28 21:50:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 21:50:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:50:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:50:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:50:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:50:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:50:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:50:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:50:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:50:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:50:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:50:36 [DEBUG   ] Finished updating board flags in 1.420 seconds
2013-06-28 21:50:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 21:50:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 21:51:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 21:51:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:51:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:51:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:51:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:51:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:51:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:51:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:51:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:51:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:51:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:51:36 [DEBUG   ] Finished updating board flags in 1.383 seconds
2013-06-28 21:51:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 21:51:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 21:52:19 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 21:52:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:52:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:52:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:52:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:52:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:52:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:52:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:52:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:52:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:52:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:52:37 [DEBUG   ] Finished updating board flags in 2.212 seconds
2013-06-28 21:52:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 21:52:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 21:53:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 21:53:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:53:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:53:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:53:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:53:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:53:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:53:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:53:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:53:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:53:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:53:37 [DEBUG   ] Finished updating board flags in 2.312 seconds
2013-06-28 21:53:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 21:53:39 [DEBUG   ] Got command RPT from MCS: ref #49328
2013-06-28 21:53:39 [DEBUG   ] summary = ERROR
2013-06-28 21:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49328  13 56471 78819393 A  ERRORERROR'
2013-06-28 21:53:39 [DEBUG   ] Got command RPT from MCS: ref #49329
2013-06-28 21:53:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 21:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49329  77 56471 78819394 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 21:53:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 21:54:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 21:54:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:54:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:54:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:54:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:54:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:54:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:54:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:54:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:54:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:54:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:54:37 [DEBUG   ] Finished updating board flags in 2.084 seconds
2013-06-28 21:54:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 21:54:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 21:55:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 21:55:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:55:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:55:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:55:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:55:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:55:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:55:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:55:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:55:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:55:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:55:37 [DEBUG   ] Finished updating board flags in 2.040 seconds
2013-06-28 21:55:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 21:55:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 21:56:19 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 21:56:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:56:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:56:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:56:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:56:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:56:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:56:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:56:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:56:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:56:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:56:37 [DEBUG   ] Finished updating board flags in 1.976 seconds
2013-06-28 21:56:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 21:56:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 21:57:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 21:57:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:57:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:57:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:57:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:57:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:57:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:57:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:57:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:57:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:57:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:57:37 [DEBUG   ] Finished updating board flags in 1.806 seconds
2013-06-28 21:57:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 21:57:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 21:58:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 21:58:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:58:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:58:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:58:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:58:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:58:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:58:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:58:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:58:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:58:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:58:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 21:58:37 [DEBUG   ] Finished updating board flags in 1.893 seconds
2013-06-28 21:58:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 21:58:39 [DEBUG   ] Got command RPT from MCS: ref #49345
2013-06-28 21:58:39 [DEBUG   ] summary = ERROR
2013-06-28 21:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49345  13 56471 79119389 A  ERRORERROR'
2013-06-28 21:58:39 [DEBUG   ] Got command RPT from MCS: ref #49346
2013-06-28 21:58:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 21:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49346  77 56471 79119390 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 21:58:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 21:59:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 21:59:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 21:59:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 21:59:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 21:59:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 21:59:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 21:59:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 21:59:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 21:59:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 21:59:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 21:59:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 21:59:37 [DEBUG   ] Finished updating board flags in 1.709 seconds
2013-06-28 21:59:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 21:59:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 22:00:19 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 22:00:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-28 22:00:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-28 22:00:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-28 22:00:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-28 22:00:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-28 22:00:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-28 22:00:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-28 22:00:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-28 22:00:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-28 22:00:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-28 22:00:37 [DEBUG   ] Finished updating board flags in 1.622 seconds
2013-06-28 22:00:39 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-28 22:01:00 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-28 22:01:20 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 196000019
2013-06-28 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 196000019
2013-06-28 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 196000019
2013-06-28 22:01:37 [DEBUG   ] Finished updating board flags in 1.614 seconds
2013-06-28 22:01:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 22:02:00 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 22:02:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-28 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-28 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-28 22:02:37 [DEBUG   ] Finished updating board flags in 1.562 seconds
2013-06-28 22:02:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 22:03:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 22:03:20 [DEBUG   ] Finished updating ant stats in 1.193 seconds
2013-06-28 22:03:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-28 22:03:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-28 22:03:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-28 22:03:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-28 22:03:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-28 22:03:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-28 22:03:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-28 22:03:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-28 22:03:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-28 22:03:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-28 22:03:37 [DEBUG   ] Finished updating board flags in 1.406 seconds
2013-06-28 22:03:39 [DEBUG   ] Got command RPT from MCS: ref #49362
2013-06-28 22:03:39 [DEBUG   ] summary = ERROR
2013-06-28 22:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49362  13 56471 79419394 A  ERRORERROR'
2013-06-28 22:03:39 [DEBUG   ] Got command RPT from MCS: ref #49363
2013-06-28 22:03:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 22:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49363  77 56471 79419394 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 22:03:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 22:04:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 22:04:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 22:04:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-28 22:04:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-28 22:04:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-28 22:04:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-28 22:04:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-28 22:04:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-28 22:04:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-28 22:04:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-28 22:04:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-28 22:04:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-28 22:04:37 [DEBUG   ] Finished updating board flags in 1.407 seconds
2013-06-28 22:04:40 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 22:05:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 22:05:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 22:05:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-28 22:05:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-28 22:05:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-28 22:05:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-28 22:05:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-28 22:05:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-28 22:05:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-28 22:05:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-28 22:05:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-28 22:05:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-28 22:05:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 22:05:37 [DEBUG   ] Finished updating board flags in 1.414 seconds
2013-06-28 22:05:40 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-28 22:06:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 22:06:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 22:06:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-28 22:06:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-28 22:06:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-28 22:06:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-28 22:06:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-28 22:06:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-28 22:06:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-28 22:06:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-28 22:06:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-28 22:06:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-28 22:06:37 [DEBUG   ] Finished updating board flags in 1.381 seconds
2013-06-28 22:06:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 22:07:00 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-28 22:07:20 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 22:07:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-28 22:07:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-28 22:07:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-28 22:07:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-28 22:07:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-28 22:07:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-28 22:07:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-28 22:07:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-28 22:07:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-28 22:07:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-28 22:07:38 [DEBUG   ] Finished updating board flags in 2.218 seconds
2013-06-28 22:07:40 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 22:08:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 22:08:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 22:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-28 22:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-28 22:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-28 22:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-28 22:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-28 22:08:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-28 22:08:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-28 22:08:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-28 22:08:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-28 22:08:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-28 22:08:38 [DEBUG   ] Finished updating board flags in 2.219 seconds
2013-06-28 22:08:39 [DEBUG   ] Got command RPT from MCS: ref #49379
2013-06-28 22:08:39 [DEBUG   ] summary = ERROR
2013-06-28 22:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49379  13 56471 79719397 A  ERRORERROR'
2013-06-28 22:08:39 [DEBUG   ] Got command RPT from MCS: ref #49380
2013-06-28 22:08:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 22:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49380  77 56471 79719398 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 22:08:40 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 22:09:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 22:09:20 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 22:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-28 22:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-28 22:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-28 22:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-28 22:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-28 22:09:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-28 22:09:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-28 22:09:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-28 22:09:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-28 22:09:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-28 22:09:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 22:09:38 [DEBUG   ] Finished updating board flags in 2.163 seconds
2013-06-28 22:09:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 22:10:00 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 22:10:20 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-28 22:10:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-28 22:10:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-28 22:10:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-28 22:10:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-28 22:10:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-28 22:10:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-28 22:10:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-28 22:10:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-28 22:10:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-28 22:10:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-28 22:10:38 [DEBUG   ] Finished updating board flags in 2.021 seconds
2013-06-28 22:10:41 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-28 22:11:01 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-28 22:11:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-28 22:11:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-28 22:11:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-28 22:11:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-28 22:11:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-28 22:11:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-28 22:11:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-28 22:11:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-28 22:11:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-28 22:11:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-28 22:11:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-28 22:11:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 22:11:38 [DEBUG   ] Finished updating board flags in 1.979 seconds
2013-06-28 22:11:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 22:12:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 22:12:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 22:12:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-28 22:12:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-28 22:12:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-28 22:12:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-28 22:12:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-28 22:12:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-28 22:12:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-28 22:12:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-28 22:12:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-28 22:12:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-28 22:12:38 [DEBUG   ] Finished updating board flags in 1.828 seconds
2013-06-28 22:12:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 22:13:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-28 22:13:21 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2013-06-28 22:13:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-28 22:13:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-28 22:13:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-28 22:13:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-28 22:13:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-28 22:13:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-28 22:13:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-28 22:13:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-28 22:13:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-28 22:13:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-28 22:13:38 [DEBUG   ] Finished updating board flags in 1.797 seconds
2013-06-28 22:13:39 [DEBUG   ] Got command RPT from MCS: ref #49396
2013-06-28 22:13:39 [DEBUG   ] summary = ERROR
2013-06-28 22:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49396  13 56471 80019393 A  ERRORERROR'
2013-06-28 22:13:39 [DEBUG   ] Got command RPT from MCS: ref #49397
2013-06-28 22:13:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 22:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49397  77 56471 80019394 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 22:13:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 22:14:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-28 22:14:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-28 22:14:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-28 22:14:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-28 22:14:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-28 22:14:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-28 22:14:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-28 22:14:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-28 22:14:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-28 22:14:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-28 22:14:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-28 22:14:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-28 22:14:38 [DEBUG   ] Finished updating board flags in 1.617 seconds
2013-06-28 22:14:41 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 22:15:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 22:15:21 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-28 22:15:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-28 22:15:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-28 22:15:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-28 22:15:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-28 22:15:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-28 22:15:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-28 22:15:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-28 22:15:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-28 22:15:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-28 22:15:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-28 22:15:38 [DEBUG   ] Finished updating board flags in 1.597 seconds
2013-06-28 22:15:41 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-28 22:16:02 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2013-06-28 22:16:22 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-28 22:16:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-28 22:16:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-28 22:16:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-28 22:16:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-28 22:16:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-28 22:16:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-28 22:16:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-28 22:16:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-28 22:16:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-28 22:16:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-28 22:16:38 [DEBUG   ] Finished updating board flags in 1.388 seconds
2013-06-28 22:16:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 22:17:03 [DEBUG   ] Finished updating ant stats in 2.200 seconds
2013-06-28 22:17:22 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2013-06-28 22:17:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-28 22:17:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-28 22:17:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-28 22:17:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-28 22:17:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-28 22:17:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-28 22:17:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-28 22:17:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-28 22:17:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-28 22:17:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-28 22:17:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 22:17:39 [DEBUG   ] Finished updating board flags in 2.197 seconds
2013-06-28 22:17:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 22:18:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-28 22:18:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 22:18:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-28 22:18:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-28 22:18:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-28 22:18:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-28 22:18:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-28 22:18:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-28 22:18:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-28 22:18:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-28 22:18:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-28 22:18:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-28 22:18:39 [DEBUG   ] Got command RPT from MCS: ref #49413
2013-06-28 22:18:39 [DEBUG   ] summary = ERROR
2013-06-28 22:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49413  13 56471 80319401 A  ERRORERROR'
2013-06-28 22:18:39 [DEBUG   ] Got command RPT from MCS: ref #49414
2013-06-28 22:18:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 22:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49414  77 56471 80319402 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 22:18:39 [DEBUG   ] Finished updating board flags in 2.035 seconds
2013-06-28 22:18:42 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2013-06-28 22:19:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 22:19:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 22:19:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-28 22:19:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-28 22:19:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-28 22:19:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-28 22:19:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-28 22:19:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-28 22:19:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-28 22:19:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-28 22:19:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-28 22:19:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-28 22:19:39 [DEBUG   ] Finished updating board flags in 1.958 seconds
2013-06-28 22:19:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 22:20:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 22:20:22 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 22:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-28 22:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-28 22:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-28 22:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-28 22:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-28 22:20:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-28 22:20:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-28 22:20:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-28 22:20:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-28 22:20:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-28 22:20:39 [DEBUG   ] Finished updating board flags in 1.848 seconds
2013-06-28 22:20:42 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-28 22:21:02 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 22:21:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 22:21:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-28 22:21:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-28 22:21:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-28 22:21:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-28 22:21:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-28 22:21:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-28 22:21:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-28 22:21:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-28 22:21:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-28 22:21:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-28 22:21:39 [DEBUG   ] Finished updating board flags in 1.756 seconds
2013-06-28 22:21:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 22:22:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 22:22:22 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 22:22:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-28 22:22:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-28 22:22:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-28 22:22:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-28 22:22:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-28 22:22:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-28 22:22:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-28 22:22:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-28 22:22:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-28 22:22:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-28 22:22:39 [DEBUG   ] Finished updating board flags in 1.645 seconds
2013-06-28 22:22:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 22:23:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-28 22:23:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 22:23:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-28 22:23:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-28 22:23:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-28 22:23:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-28 22:23:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-28 22:23:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-28 22:23:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-28 22:23:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-28 22:23:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-28 22:23:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-28 22:23:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 22:23:39 [DEBUG   ] Got command RPT from MCS: ref #49430
2013-06-28 22:23:39 [DEBUG   ] summary = ERROR
2013-06-28 22:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49430  13 56471 80619397 A  ERRORERROR'
2013-06-28 22:23:39 [DEBUG   ] Got command RPT from MCS: ref #49431
2013-06-28 22:23:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 22:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49431  77 56471 80619398 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 22:23:39 [DEBUG   ] Finished updating board flags in 1.570 seconds
2013-06-28 22:23:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-28 22:24:02 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-28 22:24:23 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-28 22:24:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-28 22:24:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-28 22:24:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-28 22:24:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-28 22:24:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-28 22:24:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-28 22:24:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-28 22:24:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-28 22:24:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-28 22:24:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-28 22:24:39 [DEBUG   ] Finished updating board flags in 1.479 seconds
2013-06-28 22:24:43 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-28 22:25:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 22:25:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 22:25:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-28 22:25:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-28 22:25:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-28 22:25:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-28 22:25:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-28 22:25:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-28 22:25:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-28 22:25:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-28 22:25:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-28 22:25:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-28 22:25:40 [DEBUG   ] Finished updating board flags in 2.341 seconds
2013-06-28 22:25:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 22:26:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 22:26:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 22:26:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-28 22:26:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-28 22:26:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-28 22:26:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-28 22:26:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-28 22:26:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-28 22:26:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-28 22:26:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-28 22:26:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-28 22:26:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-28 22:26:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 22:26:40 [DEBUG   ] Finished updating board flags in 2.173 seconds
2013-06-28 22:26:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 22:27:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 22:27:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 22:27:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-28 22:27:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-28 22:27:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-28 22:27:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-28 22:27:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-28 22:27:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-28 22:27:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-28 22:27:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-28 22:27:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-28 22:27:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-28 22:27:40 [DEBUG   ] Finished updating board flags in 2.090 seconds
2013-06-28 22:27:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-28 22:28:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 22:28:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 22:28:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-28 22:28:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-28 22:28:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-28 22:28:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-28 22:28:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-28 22:28:39 [DEBUG   ] Got command RPT from MCS: ref #49447
2013-06-28 22:28:39 [DEBUG   ] summary = ERROR
2013-06-28 22:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49447  13 56471 80919401 A  ERRORERROR'
2013-06-28 22:28:39 [DEBUG   ] Got command RPT from MCS: ref #49448
2013-06-28 22:28:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 22:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49448  77 56471 80919402 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 22:28:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-28 22:28:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-28 22:28:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-28 22:28:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-28 22:28:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-28 22:28:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 22:28:40 [DEBUG   ] Finished updating board flags in 1.929 seconds
2013-06-28 22:28:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 22:29:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 22:29:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 22:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-28 22:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-28 22:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-28 22:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-28 22:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-28 22:29:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-28 22:29:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-28 22:29:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-28 22:29:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-28 22:29:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-28 22:29:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-28 22:29:40 [DEBUG   ] Finished updating board flags in 1.841 seconds
2013-06-28 22:29:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 22:30:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 22:30:23 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2013-06-28 22:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-28 22:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-28 22:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-28 22:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-28 22:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-28 22:30:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-28 22:30:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-28 22:30:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-28 22:30:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-28 22:30:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-28 22:30:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 22:30:40 [DEBUG   ] Finished updating board flags in 1.807 seconds
2013-06-28 22:30:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 22:31:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 22:31:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998921
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998921
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998921
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998921
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998921
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 90117486
2013-06-28 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998921
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998921
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998921
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998921
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998921
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 90117486
2013-06-28 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 90117486
2013-06-28 22:31:40 [DEBUG   ] Finished updating board flags in 1.754 seconds
2013-06-28 22:31:43 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-28 22:32:03 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 22:32:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192678944
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192678101
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192678703
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192677636
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192678365
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 1, top port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 1, bottom port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 5, top port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 5, bottom port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa24, chip 1, top port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa24, chip 1, bottom port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa24, chip 5, bottom port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 1, top port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 1, bottom port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 5, top port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 5, bottom port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 1, top port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 1, bottom port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 5, top port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 5, bottom port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa10, chip 1, top port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa10, chip 1, bottom port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa10, chip 5, top port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa10, chip 5, bottom port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 1, top port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 1, bottom port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 5, top port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 5, bottom port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa11, chip 1, top port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa11, chip 1, bottom port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa11, chip 5, top port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa11, chip 5, bottom port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa30, chip 1, top port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa30, chip 1, bottom port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa30, chip 5, top port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa30, chip 5, bottom port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 1, top port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 1, bottom port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 5, top port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 5, bottom port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa8, chip 1, top port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa8, chip 5, top port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa8, chip 5, bottom port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 1, top port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 1, bottom port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 5, top port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 5, bottom port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, top port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 5, top port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 5, bottom port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 1, top port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 2, top port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 4, bottom port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-28 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 5, bottom port
2013-06-28 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192508297
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192507674
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192507718
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192507389
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192507169
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 1, top port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 1, bottom port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 5, top port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 5, bottom port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 1, top port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 1, bottom port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 5, bottom port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 1, top port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 1, bottom port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 5, top port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 5, bottom port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 1, top port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 1, bottom port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 5, top port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 5, bottom port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 1, top port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 1, bottom port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 5, top port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 5, bottom port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 1, top port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 1, bottom port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 5, top port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 5, bottom port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 1, top port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 1, bottom port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 5, top port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 5, bottom port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 1, top port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 1, bottom port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 5, top port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 5, bottom port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 1, top port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 1, bottom port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 5, top port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 5, bottom port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 1, top port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, top port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 1, top port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 1, bottom port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 5, top port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 5, bottom port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 1, top port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 1, bottom port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 5, top port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 5, bottom port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 1, top port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 2, top port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 4, bottom port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-28 22:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 5, bottom port
2013-06-28 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-28 22:32:40 [CRITICAL] MGT underflow detected on beam(s) 1, 4, 2, 3
2013-06-28 22:32:40 [DEBUG   ] Finished updating board flags in 1.630 seconds
2013-06-28 22:32:43 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 22:33:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 22:33:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192678978
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192678135
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192678737
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192677670
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192678399
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 196000033
2013-06-28 22:33:39 [DEBUG   ] Got command RPT from MCS: ref #49464
2013-06-28 22:33:39 [DEBUG   ] summary = ERROR
2013-06-28 22:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49464  13 56471 81219405 A  ERRORERROR'
2013-06-28 22:33:39 [DEBUG   ] Got command RPT from MCS: ref #49465
2013-06-28 22:33:39 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 22:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49465  98 56471 81219406 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 196000033
2013-06-28 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192508331
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192507708
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192507752
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192507423
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192507203
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 196000033
2013-06-28 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 196000033
2013-06-28 22:33:40 [DEBUG   ] Finished updating board flags in 1.569 seconds
2013-06-28 22:33:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-28 22:34:03 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-28 22:34:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192678978
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192678135
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192678737
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192677670
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192678399
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-28 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192508331
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192507708
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192507752
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192507423
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192507203
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-28 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-28 22:34:40 [DEBUG   ] Finished updating board flags in 1.558 seconds
2013-06-28 22:34:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 22:34:45 [DEBUG   ] Got command TBW from MCS: ref #49482
2013-06-28 22:34:45 [DEBUG   ] tbw = exited with status True, code 0x00
2013-06-28 22:34:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    49482   8 56471 81285574 A  ERROR'
2013-06-28 22:34:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-06-28 22:34:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-06-28 22:34:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-06-28 22:34:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-06-28 22:34:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-06-28 22:34:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-06-28 22:34:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-06-28 22:34:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-06-28 22:34:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-06-28 22:34:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-06-28 22:34:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-06-28 22:34:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-06-28 22:34:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-06-28 22:34:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-06-28 22:34:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-06-28 22:34:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-06-28 22:34:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-06-28 22:34:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-06-28 22:34:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-06-28 22:34:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-06-28 22:34:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-06-28 22:34:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-06-28 22:34:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-06-28 22:34:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-06-28 22:34:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-06-28 22:34:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-06-28 22:34:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-06-28 22:34:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-06-28 22:34:49 [DEBUG   ] spawn_process: at 2013-06-28 22:34:49 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-06-28 22:34:49 [DEBUG   ] spawn_process: at 2013-06-28 22:34:49 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-06-28 22:34:49 [DEBUG   ] spawn_process: at 2013-06-28 22:34:49 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-06-28 22:34:49 [DEBUG   ] spawn_process: at 2013-06-28 22:34:49 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-06-28 22:34:49 [DEBUG   ] spawn_process: at 2013-06-28 22:34:49 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-06-28 22:34:49 [DEBUG   ] spawn_process: at 2013-06-28 22:34:49 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-06-28 22:34:49 [DEBUG   ] spawn_process: at 2013-06-28 22:34:49 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-06-28 22:34:49 [DEBUG   ] spawn_process: at 2013-06-28 22:34:49 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-06-28 22:34:49 [DEBUG   ] spawn_process: at 2013-06-28 22:34:49 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-06-28 22:34:49 [DEBUG   ] spawn_process: at 2013-06-28 22:34:49 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-06-28 22:34:49 [DEBUG   ] spawn_process: at 2013-06-28 22:34:49 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-06-28 22:34:49 [DEBUG   ] spawn_process: at 2013-06-28 22:34:49 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-06-28 22:34:49 [DEBUG   ] spawn_process: at 2013-06-28 22:34:49 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-06-28 22:34:49 [DEBUG   ] spawn_process: at 2013-06-28 22:34:49 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-06-28 22:34:49 [DEBUG   ] spawn_process: at 2013-06-28 22:34:49 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-06-28 22:34:49 [DEBUG   ] spawn_process: at 2013-06-28 22:34:49 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-06-28 22:34:49 [DEBUG   ] spawn_process: at 2013-06-28 22:34:49 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-06-28 22:34:49 [DEBUG   ] spawn_process: at 2013-06-28 22:34:49 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-06-28 22:34:49 [DEBUG   ] spawn_process: at 2013-06-28 22:34:49 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-06-28 22:34:49 [DEBUG   ] spawn_process: at 2013-06-28 22:34:49 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-06-28 22:34:49 [DEBUG   ] spawn_process: at 2013-06-28 22:34:49 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-06-28 22:34:49 [DEBUG   ] spawn_process: at 2013-06-28 22:34:49 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-06-28 22:34:49 [DEBUG   ] spawn_process: at 2013-06-28 22:34:49 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-06-28 22:34:49 [DEBUG   ] spawn_process: at 2013-06-28 22:34:49 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-06-28 22:34:49 [DEBUG   ] spawn_process: at 2013-06-28 22:34:49 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-06-28 22:34:49 [DEBUG   ] spawn_process: at 2013-06-28 22:34:49 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-06-28 22:34:49 [INFO    ] Finished spawning TBW
2013-06-28 22:35:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192678978
2013-06-28 22:35:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192678135
2013-06-28 22:35:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192678737
2013-06-28 22:35:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192677670
2013-06-28 22:35:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192678399
2013-06-28 22:35:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192508331
2013-06-28 22:35:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192507708
2013-06-28 22:35:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192507752
2013-06-28 22:35:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192507423
2013-06-28 22:35:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192507203
2013-06-28 22:35:41 [DEBUG   ] Finished updating board flags in 2.160 seconds
2013-06-28 22:36:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192678978
2013-06-28 22:36:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192678135
2013-06-28 22:36:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192678737
2013-06-28 22:36:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192677670
2013-06-28 22:36:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192678399
2013-06-28 22:36:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192508331
2013-06-28 22:36:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192507708
2013-06-28 22:36:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192507752
2013-06-28 22:36:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192507423
2013-06-28 22:36:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192507203
2013-06-28 22:36:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-28 22:36:41 [DEBUG   ] Finished updating board flags in 2.013 seconds
2013-06-28 22:37:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192678978
2013-06-28 22:37:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192678135
2013-06-28 22:37:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192678737
2013-06-28 22:37:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192677670
2013-06-28 22:37:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192678399
2013-06-28 22:37:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192508331
2013-06-28 22:37:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192507708
2013-06-28 22:37:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192507752
2013-06-28 22:37:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192507423
2013-06-28 22:37:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192507203
2013-06-28 22:37:41 [DEBUG   ] Finished updating board flags in 1.876 seconds
2013-06-28 22:38:28 [INFO    ] __waitForTBW - TBW finished in 218.770 s
2013-06-28 22:38:29 [INFO    ] Started antennas statistics background thread
2013-06-28 22:38:29 [INFO    ] Resuming TBN at 37.900 MHz after TBW acquisition
2013-06-28 22:38:29 [DEBUG   ] spawn_process: at 2013-06-28 22:38:29 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '1', '1372459110']
2013-06-28 22:38:29 [DEBUG   ] spawn_process: at 2013-06-28 22:38:29 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '2', '1372459110']
2013-06-28 22:38:29 [DEBUG   ] spawn_process: at 2013-06-28 22:38:29 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '3', '1372459110']
2013-06-28 22:38:29 [DEBUG   ] spawn_process: at 2013-06-28 22:38:29 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '4', '1372459110']
2013-06-28 22:38:29 [DEBUG   ] spawn_process: at 2013-06-28 22:38:29 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '5', '1372459110']
2013-06-28 22:38:29 [DEBUG   ] spawn_process: at 2013-06-28 22:38:29 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '6', '1372459110']
2013-06-28 22:38:29 [DEBUG   ] spawn_process: at 2013-06-28 22:38:29 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '7', '1372459110']
2013-06-28 22:38:29 [DEBUG   ] spawn_process: at 2013-06-28 22:38:29 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '8', '1372459110']
2013-06-28 22:38:29 [DEBUG   ] spawn_process: at 2013-06-28 22:38:29 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '9', '1372459110']
2013-06-28 22:38:29 [DEBUG   ] spawn_process: at 2013-06-28 22:38:29 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '10', '1372459110']
2013-06-28 22:38:29 [DEBUG   ] spawn_process: at 2013-06-28 22:38:29 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '11', '1372459110']
2013-06-28 22:38:29 [DEBUG   ] spawn_process: at 2013-06-28 22:38:29 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '12', '1372459110']
2013-06-28 22:38:29 [DEBUG   ] spawn_process: at 2013-06-28 22:38:29 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '13', '1372459110']
2013-06-28 22:38:29 [DEBUG   ] spawn_process: at 2013-06-28 22:38:29 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '14', '1372459110']
2013-06-28 22:38:29 [DEBUG   ] spawn_process: at 2013-06-28 22:38:29 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '15', '1372459110']
2013-06-28 22:38:29 [DEBUG   ] spawn_process: at 2013-06-28 22:38:29 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '16', '1372459110']
2013-06-28 22:38:29 [DEBUG   ] spawn_process: at 2013-06-28 22:38:29 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '17', '1372459110']
2013-06-28 22:38:29 [DEBUG   ] spawn_process: at 2013-06-28 22:38:29 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '18', '1372459110']
2013-06-28 22:38:29 [DEBUG   ] spawn_process: at 2013-06-28 22:38:29 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '19', '1372459110']
2013-06-28 22:38:29 [DEBUG   ] spawn_process: at 2013-06-28 22:38:29 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '20', '1372459110']
2013-06-28 22:38:29 [DEBUG   ] spawn_process: at 2013-06-28 22:38:29 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '21', '1372459110']
2013-06-28 22:38:29 [DEBUG   ] spawn_process: at 2013-06-28 22:38:29 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '22', '1372459110']
2013-06-28 22:38:29 [DEBUG   ] spawn_process: at 2013-06-28 22:38:29 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '23', '1372459110']
2013-06-28 22:38:29 [DEBUG   ] spawn_process: at 2013-06-28 22:38:29 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '24', '1372459110']
2013-06-28 22:38:29 [DEBUG   ] spawn_process: at 2013-06-28 22:38:29 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '25', '1372459110']
2013-06-28 22:38:29 [DEBUG   ] spawn_process: at 2013-06-28 22:38:29 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '26', '1372459110']
2013-06-28 22:38:29 [INFO    ] Finished spawning TBN in 0.054 s
2013-06-28 22:38:29 [DEBUG   ] Finished updating ant stats in 1.158 seconds
2013-06-28 22:38:39 [DEBUG   ] Got command RPT from MCS: ref #49491
2013-06-28 22:38:39 [DEBUG   ] summary = ERROR
2013-06-28 22:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49491  13 56471 81519401 A  ERRORERROR'
2013-06-28 22:38:39 [DEBUG   ] Got command RPT from MCS: ref #49492
2013-06-28 22:38:39 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-28 22:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49492  98 56471 81519402 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-28 22:38:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192678978
2013-06-28 22:38:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192678135
2013-06-28 22:38:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192678737
2013-06-28 22:38:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192677670
2013-06-28 22:38:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192678399
2013-06-28 22:38:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192508331
2013-06-28 22:38:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192507708
2013-06-28 22:38:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192507752
2013-06-28 22:38:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192507423
2013-06-28 22:38:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192507203
2013-06-28 22:38:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2013-06-28 22:38:41 [DEBUG   ] Finished updating board flags in 2.003 seconds
2013-06-28 22:38:49 [DEBUG   ] Finished updating ant stats in 0.979 seconds
2013-06-28 22:38:51 [DEBUG   ] Got command INI from MCS: ref #49510
2013-06-28 22:38:51 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2013-06-28 22:38:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    49510   8 56471 81531426 ABOOTING'
2013-06-28 22:39:15 [INFO    ] -------------------
2013-06-28 22:39:15 [INFO    ]  LWA board status
2013-06-28 22:39:15 [INFO    ] -------------------
2013-06-28 22:39:15 [INFO    ] DP 1: 2 lwa27
2013-06-28 22:39:15 [INFO    ] DP 1: 3 lwa24
2013-06-28 22:39:15 [INFO    ] DP 1: 4 lwa23
2013-06-28 22:39:15 [INFO    ] DP 1: 5 lwa18
2013-06-28 22:39:15 [INFO    ] DP 1: 6 lwa10
2013-06-28 22:39:15 [INFO    ] DP 1: 7 lwa32
2013-06-28 22:39:15 [INFO    ] DP 1: 8 lwa11
2013-06-28 22:39:15 [INFO    ] DP 1: 9 lwa30
2013-06-28 22:39:15 [INFO    ] DP 1: 10 lwa12
2013-06-28 22:39:15 [INFO    ] DP 1: 11 lwa8
2013-06-28 22:39:15 [INFO    ] DP 1: 12 lwa13
2013-06-28 22:39:15 [INFO    ] DP 1: 13 lwa26
2013-06-28 22:39:15 [INFO    ] DP 1: 14 lwa14
2013-06-28 22:39:15 [INFO    ] DP 1: 16 lwa22
2013-06-28 22:39:15 [INFO    ] DP 1: 17 lwa20
2013-06-28 22:39:15 [INFO    ] DP 1: 18 lwa1
2013-06-28 22:39:15 [INFO    ] DP 1: 19 lwa5
2013-06-28 22:39:15 [INFO    ] DP 1: 20 lwa25
2013-06-28 22:39:15 [INFO    ] DP 1: 21 lwa35
2013-06-28 22:39:15 [INFO    ] DP 1: 22 lwa19
2013-06-28 22:39:15 [INFO    ] DP 1: 23 lwa21
2013-06-28 22:39:15 [INFO    ] DP 1: 24 lwa6
2013-06-28 22:39:15 [INFO    ] DP 1: 25 lwa7
2013-06-28 22:39:15 [INFO    ] DP 1: 26 lwa33
2013-06-28 22:39:15 [INFO    ] DP 1: 27 lwa15
2013-06-28 22:39:15 [INFO    ] DP 1: 28 lwa28
2013-06-28 22:39:15 [INFO    ] DP 2: 1 lwa16
2013-06-28 22:39:15 [INFO    ] DP 2: 15 lwa34
2013-06-28 22:39:15 [INFO    ] Total of 28 boards
2013-06-28 22:39:15 [INFO    ] Total of 260 stands
2013-06-28 22:39:15 [INFO    ] -------------------
2013-06-28 22:39:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2013-06-28 22:39:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2013-06-28 22:39:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2013-06-28 22:39:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2013-06-28 22:39:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2013-06-28 22:39:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2013-06-28 22:39:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2013-06-28 22:39:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2013-06-28 22:39:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2013-06-28 22:39:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2013-06-28 22:39:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2013-06-28 22:39:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2013-06-28 22:39:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2013-06-28 22:39:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2013-06-28 22:39:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2013-06-28 22:39:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2013-06-28 22:39:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2013-06-28 22:39:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2013-06-28 22:39:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2013-06-28 22:39:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2013-06-28 22:39:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2013-06-28 22:39:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2013-06-28 22:39:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2013-06-28 22:39:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2013-06-28 22:39:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2013-06-28 22:39:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2013-06-28 22:39:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2013-06-28 22:39:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2013-06-28 22:39:23 [DEBUG   ] 2013-06-28 22:39:23 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12428
2013-06-28 22:39:23 [DEBUG   ] 2013-06-28 22:39:23 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12429
2013-06-28 22:39:23 [DEBUG   ] 2013-06-28 22:39:23 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12430
2013-06-28 22:39:23 [DEBUG   ] 2013-06-28 22:39:23 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12431
2013-06-28 22:39:23 [DEBUG   ] 2013-06-28 22:39:23 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12432
2013-06-28 22:39:23 [DEBUG   ] 2013-06-28 22:39:23 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12433
2013-06-28 22:39:23 [DEBUG   ] 2013-06-28 22:39:23 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12434
2013-06-28 22:39:23 [DEBUG   ] 2013-06-28 22:39:23 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12435
2013-06-28 22:39:23 [DEBUG   ] 2013-06-28 22:39:23 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12436
2013-06-28 22:39:23 [DEBUG   ] 2013-06-28 22:39:23 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12437
2013-06-28 22:39:23 [DEBUG   ] 2013-06-28 22:39:23 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12438
2013-06-28 22:39:23 [DEBUG   ] 2013-06-28 22:39:23 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12439
2013-06-28 22:39:23 [DEBUG   ] 2013-06-28 22:39:23 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12440
2013-06-28 22:39:23 [DEBUG   ] 2013-06-28 22:39:23 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12441
2013-06-28 22:39:23 [DEBUG   ] 2013-06-28 22:39:23 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12442
2013-06-28 22:39:23 [DEBUG   ] 2013-06-28 22:39:23 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12443
2013-06-28 22:39:23 [DEBUG   ] 2013-06-28 22:39:23 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12444
2013-06-28 22:39:23 [DEBUG   ] 2013-06-28 22:39:23 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12445
2013-06-28 22:39:23 [DEBUG   ] 2013-06-28 22:39:23 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12446
2013-06-28 22:39:23 [DEBUG   ] 2013-06-28 22:39:23 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12447
2013-06-28 22:39:23 [DEBUG   ] 2013-06-28 22:39:23 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12448
2013-06-28 22:39:23 [DEBUG   ] 2013-06-28 22:39:23 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12449
2013-06-28 22:39:23 [DEBUG   ] 2013-06-28 22:39:23 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12450
2013-06-28 22:39:23 [DEBUG   ] 2013-06-28 22:39:23 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12451
2013-06-28 22:39:23 [DEBUG   ] 2013-06-28 22:39:23 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12452
2013-06-28 22:39:23 [DEBUG   ] 2013-06-28 22:39:23 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12453
2013-06-28 22:39:35 [DEBUG   ] 2013-06-28 22:39:35 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12428 exited with status 0
2013-06-28 22:39:35 [DEBUG   ] 2013-06-28 22:39:35 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12429 exited with status 0
2013-06-28 22:39:35 [DEBUG   ] 2013-06-28 22:39:35 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12430 exited with status 0
2013-06-28 22:39:35 [DEBUG   ] 2013-06-28 22:39:35 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12431 exited with status 0
2013-06-28 22:39:35 [DEBUG   ] 2013-06-28 22:39:35 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12432 exited with status 0
2013-06-28 22:39:35 [DEBUG   ] 2013-06-28 22:39:35 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12433 exited with status 0
2013-06-28 22:39:35 [DEBUG   ] 2013-06-28 22:39:35 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12434 exited with status 0
2013-06-28 22:39:35 [DEBUG   ] 2013-06-28 22:39:35 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12435 exited with status 0
2013-06-28 22:39:35 [DEBUG   ] 2013-06-28 22:39:35 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12436 exited with status 0
2013-06-28 22:39:35 [DEBUG   ] 2013-06-28 22:39:35 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12437 exited with status 0
2013-06-28 22:39:35 [DEBUG   ] 2013-06-28 22:39:35 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12438 exited with status 0
2013-06-28 22:39:35 [DEBUG   ] 2013-06-28 22:39:35 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12439 exited with status 0
2013-06-28 22:39:35 [DEBUG   ] 2013-06-28 22:39:35 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12440 exited with status 0
2013-06-28 22:39:35 [DEBUG   ] 2013-06-28 22:39:35 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12441 exited with status 0
2013-06-28 22:39:35 [DEBUG   ] 2013-06-28 22:39:35 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12442 exited with status 0
2013-06-28 22:39:35 [DEBUG   ] 2013-06-28 22:39:35 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12443 exited with status 0
2013-06-28 22:39:35 [DEBUG   ] 2013-06-28 22:39:35 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12444 exited with status 0
2013-06-28 22:39:35 [DEBUG   ] 2013-06-28 22:39:35 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12445 exited with status 0
2013-06-28 22:39:35 [DEBUG   ] 2013-06-28 22:39:35 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12446 exited with status 0
2013-06-28 22:39:35 [DEBUG   ] 2013-06-28 22:39:35 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12447 exited with status 0
2013-06-28 22:39:35 [DEBUG   ] 2013-06-28 22:39:35 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12448 exited with status 0
2013-06-28 22:39:35 [DEBUG   ] 2013-06-28 22:39:35 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12449 exited with status 0
2013-06-28 22:39:35 [DEBUG   ] 2013-06-28 22:39:35 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12450 exited with status 0
2013-06-28 22:39:35 [DEBUG   ] 2013-06-28 22:39:35 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12451 exited with status 0
2013-06-28 22:39:35 [DEBUG   ] 2013-06-28 22:39:35 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12452 exited with status 0
2013-06-28 22:39:35 [DEBUG   ] 2013-06-28 22:39:35 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12453 exited with status 0
2013-06-28 22:39:35 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2013-06-28 22:39:35 [DEBUG   ] spawn_process: at 2013-06-28 22:39:35 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2013-06-28 22:39:35 [DEBUG   ] spawn_process: at 2013-06-28 22:39:35 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2013-06-28 22:39:35 [DEBUG   ] spawn_process: at 2013-06-28 22:39:35 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2013-06-28 22:39:35 [DEBUG   ] spawn_process: at 2013-06-28 22:39:35 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2013-06-28 22:39:35 [DEBUG   ] spawn_process: at 2013-06-28 22:39:35 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2013-06-28 22:39:35 [DEBUG   ] spawn_process: at 2013-06-28 22:39:35 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2013-06-28 22:39:35 [DEBUG   ] spawn_process: at 2013-06-28 22:39:35 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2013-06-28 22:39:35 [DEBUG   ] spawn_process: at 2013-06-28 22:39:35 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2013-06-28 22:39:35 [DEBUG   ] spawn_process: at 2013-06-28 22:39:35 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2013-06-28 22:39:35 [DEBUG   ] spawn_process: at 2013-06-28 22:39:35 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2013-06-28 22:39:35 [DEBUG   ] spawn_process: at 2013-06-28 22:39:35 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2013-06-28 22:39:35 [DEBUG   ] spawn_process: at 2013-06-28 22:39:35 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2013-06-28 22:39:35 [DEBUG   ] spawn_process: at 2013-06-28 22:39:35 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2013-06-28 22:39:35 [DEBUG   ] spawn_process: at 2013-06-28 22:39:35 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2013-06-28 22:39:35 [DEBUG   ] spawn_process: at 2013-06-28 22:39:35 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2013-06-28 22:39:35 [DEBUG   ] spawn_process: at 2013-06-28 22:39:35 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2013-06-28 22:39:35 [DEBUG   ] spawn_process: at 2013-06-28 22:39:35 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2013-06-28 22:39:35 [DEBUG   ] spawn_process: at 2013-06-28 22:39:35 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2013-06-28 22:39:35 [DEBUG   ] spawn_process: at 2013-06-28 22:39:35 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2013-06-28 22:39:35 [DEBUG   ] spawn_process: at 2013-06-28 22:39:35 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2013-06-28 22:39:35 [DEBUG   ] spawn_process: at 2013-06-28 22:39:35 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2013-06-28 22:39:35 [DEBUG   ] spawn_process: at 2013-06-28 22:39:35 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2013-06-28 22:39:35 [DEBUG   ] spawn_process: at 2013-06-28 22:39:35 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2013-06-28 22:39:35 [DEBUG   ] spawn_process: at 2013-06-28 22:39:35 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2013-06-28 22:39:35 [DEBUG   ] spawn_process: at 2013-06-28 22:39:35 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2013-06-28 22:39:35 [DEBUG   ] spawn_process: at 2013-06-28 22:39:35 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2013-06-28 22:39:35 [DEBUG   ] 2013-06-28 22:39:35 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 12480
2013-06-28 22:39:35 [DEBUG   ] 2013-06-28 22:39:35 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 12481
2013-06-28 22:39:41 [DEBUG   ] 2013-06-28 22:39:41 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 12480 exited with status 0
2013-06-28 22:39:41 [DEBUG   ] 2013-06-28 22:39:41 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 12481 exited with status 0
2013-06-28 22:39:41 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2013-06-28 22:39:41 [DEBUG   ] spawn_process: at 2013-06-28 22:39:41 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2013-06-28 22:39:41 [DEBUG   ] spawn_process: at 2013-06-28 22:39:41 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2013-06-28 22:39:41 [INFO    ] Setting Beam 1 xbars
2013-06-28 22:39:41 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2013-06-28 22:39:41 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2013-06-28 22:39:41 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2013-06-28 22:39:41 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2013-06-28 22:39:41 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2013-06-28 22:39:41 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2013-06-28 22:39:41 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2013-06-28 22:39:41 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2013-06-28 22:39:42 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2013-06-28 22:39:42 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2013-06-28 22:39:42 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2013-06-28 22:39:42 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2013-06-28 22:39:42 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2013-06-28 22:39:42 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2013-06-28 22:39:42 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2013-06-28 22:39:42 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2013-06-28 22:39:42 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2013-06-28 22:39:43 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2013-06-28 22:39:43 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2013-06-28 22:39:43 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2013-06-28 22:39:43 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2013-06-28 22:39:43 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2013-06-28 22:39:43 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2013-06-28 22:39:43 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2013-06-28 22:39:43 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2013-06-28 22:39:43 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2013-06-28 22:39:44 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2013-06-28 22:39:44 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2013-06-28 22:39:44 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2013-06-28 22:39:44 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2013-06-28 22:39:44 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2013-06-28 22:39:44 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2013-06-28 22:39:44 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2013-06-28 22:39:44 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2013-06-28 22:39:44 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2013-06-28 22:39:45 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2013-06-28 22:39:45 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2013-06-28 22:39:45 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2013-06-28 22:39:45 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2013-06-28 22:39:45 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2013-06-28 22:39:45 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2013-06-28 22:39:45 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2013-06-28 22:39:45 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2013-06-28 22:39:45 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2013-06-28 22:39:46 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2013-06-28 22:39:46 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2013-06-28 22:39:46 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2013-06-28 22:39:46 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2013-06-28 22:39:46 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2013-06-28 22:39:46 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2013-06-28 22:39:46 [INFO    ] Setting Beam 2 xbars
2013-06-28 22:39:46 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2013-06-28 22:39:46 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2013-06-28 22:39:46 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2013-06-28 22:39:46 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2013-06-28 22:39:47 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2013-06-28 22:39:47 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2013-06-28 22:39:47 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2013-06-28 22:39:47 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2013-06-28 22:39:47 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2013-06-28 22:39:47 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2013-06-28 22:39:47 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2013-06-28 22:39:47 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2013-06-28 22:39:47 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2013-06-28 22:39:48 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2013-06-28 22:39:48 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2013-06-28 22:39:48 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2013-06-28 22:39:48 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2013-06-28 22:39:48 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2013-06-28 22:39:48 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2013-06-28 22:39:48 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2013-06-28 22:39:48 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2013-06-28 22:39:48 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2013-06-28 22:39:49 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2013-06-28 22:39:49 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2013-06-28 22:39:49 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2013-06-28 22:39:49 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2013-06-28 22:39:49 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2013-06-28 22:39:49 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2013-06-28 22:39:49 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2013-06-28 22:39:49 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2013-06-28 22:39:49 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2013-06-28 22:39:50 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2013-06-28 22:39:50 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2013-06-28 22:39:50 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2013-06-28 22:39:50 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2013-06-28 22:39:50 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2013-06-28 22:39:50 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2013-06-28 22:39:50 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2013-06-28 22:39:50 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2013-06-28 22:39:50 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2013-06-28 22:39:50 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2013-06-28 22:39:51 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2013-06-28 22:39:51 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2013-06-28 22:39:51 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2013-06-28 22:39:51 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2013-06-28 22:39:51 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2013-06-28 22:39:51 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2013-06-28 22:39:51 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2013-06-28 22:39:51 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2013-06-28 22:39:51 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2013-06-28 22:39:52 [INFO    ] Setting Beam 3 xbars
2013-06-28 22:39:52 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2013-06-28 22:39:52 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2013-06-28 22:39:52 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2013-06-28 22:39:52 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2013-06-28 22:39:52 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2013-06-28 22:39:52 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2013-06-28 22:39:52 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2013-06-28 22:39:52 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2013-06-28 22:39:52 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2013-06-28 22:39:53 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2013-06-28 22:39:53 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2013-06-28 22:39:53 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2013-06-28 22:39:53 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2013-06-28 22:39:53 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2013-06-28 22:39:54 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2013-06-28 22:39:54 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2013-06-28 22:39:54 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2013-06-28 22:39:54 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2013-06-28 22:39:54 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2013-06-28 22:39:54 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2013-06-28 22:39:54 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2013-06-28 22:39:54 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2013-06-28 22:39:54 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2013-06-28 22:39:54 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2013-06-28 22:39:55 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2013-06-28 22:39:55 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2013-06-28 22:39:55 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2013-06-28 22:39:55 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2013-06-28 22:39:55 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2013-06-28 22:39:55 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2013-06-28 22:39:55 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2013-06-28 22:39:55 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2013-06-28 22:39:55 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2013-06-28 22:39:56 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2013-06-28 22:39:56 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2013-06-28 22:39:56 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2013-06-28 22:39:56 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2013-06-28 22:39:56 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2013-06-28 22:39:56 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2013-06-28 22:39:56 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2013-06-28 22:39:56 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2013-06-28 22:39:56 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2013-06-28 22:39:57 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2013-06-28 22:39:57 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2013-06-28 22:39:57 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2013-06-28 22:39:57 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2013-06-28 22:39:57 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2013-06-28 22:39:57 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2013-06-28 22:39:57 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2013-06-28 22:39:57 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2013-06-28 22:39:57 [INFO    ] Setting Beam 4 xbars
2013-06-28 22:39:57 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2013-06-28 22:39:58 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2013-06-28 22:39:58 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2013-06-28 22:39:58 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2013-06-28 22:39:58 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2013-06-28 22:39:58 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2013-06-28 22:39:58 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2013-06-28 22:39:58 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2013-06-28 22:39:58 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2013-06-28 22:39:58 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2013-06-28 22:39:58 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2013-06-28 22:39:59 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2013-06-28 22:39:59 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2013-06-28 22:39:59 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2013-06-28 22:39:59 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2013-06-28 22:39:59 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2013-06-28 22:39:59 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2013-06-28 22:39:59 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2013-06-28 22:39:59 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2013-06-28 22:39:59 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2013-06-28 22:40:00 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2013-06-28 22:40:00 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2013-06-28 22:40:00 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2013-06-28 22:40:00 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2013-06-28 22:40:00 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2013-06-28 22:40:00 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2013-06-28 22:40:00 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2013-06-28 22:40:00 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2013-06-28 22:40:00 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2013-06-28 22:40:01 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2013-06-28 22:40:01 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2013-06-28 22:40:01 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2013-06-28 22:40:01 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2013-06-28 22:40:01 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2013-06-28 22:40:01 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2013-06-28 22:40:01 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2013-06-28 22:40:01 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2013-06-28 22:40:01 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2013-06-28 22:40:02 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2013-06-28 22:40:02 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2013-06-28 22:40:02 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2013-06-28 22:40:02 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2013-06-28 22:40:02 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2013-06-28 22:40:02 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2013-06-28 22:40:02 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2013-06-28 22:40:02 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2013-06-28 22:40:02 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2013-06-28 22:40:03 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2013-06-28 22:40:03 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2013-06-28 22:40:03 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2013-06-28 22:40:03 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2013-06-28 22:40:03 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2013-06-28 22:40:03 [INFO    ] All xbars set
2013-06-28 22:40:03 [INFO    ] Setting adder chain routing for all beams
2013-06-28 22:40:08 [INFO    ] Setting beam ids
2013-06-28 22:40:18 [INFO    ] Starting beam delay calibration
2013-06-28 22:40:30 [INFO    ] Beam 1 latency is 6675
2013-06-28 22:40:30 [INFO    ] Beam 2 latency is 5767
2013-06-28 22:40:30 [INFO    ] Beam 3 latency is 5751
2013-06-28 22:40:30 [INFO    ] Beam 4 latency is 6697
2013-06-28 22:40:30 [INFO    ] Stop calibration
2013-06-28 22:40:39 [ERROR   ] Beam delay calibration failed
2013-06-28 22:40:39 [CRITICAL] Calibration failed
2013-06-28 22:40:39 [DEBUG   ] spawn_process: at 2013-06-28 22:40:39 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2013-06-28 22:40:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2013-06-28 22:40:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2013-06-28 22:40:39 [DEBUG   ] spawn_process: at 2013-06-28 22:40:39 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2013-06-28 22:40:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2013-06-28 22:40:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2013-06-28 22:40:39 [DEBUG   ] spawn_process: at 2013-06-28 22:40:39 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2013-06-28 22:40:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2013-06-28 22:40:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2013-06-28 22:40:39 [DEBUG   ] spawn_process: at 2013-06-28 22:40:39 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2013-06-28 22:40:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2013-06-28 22:40:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2013-06-28 22:40:39 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2013-06-28 22:40:40 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 88 ms (1372459240.090 s) with PID 14099 and time 1372459239
2013-06-28 22:40:40 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2013-06-28 22:40:40 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 177 ms (1372459240.179 s) with PID 14102 and time 1372459239
2013-06-28 22:40:41 [INFO    ] Started antennas statistics background thread
2013-06-28 22:40:41 [INFO    ] Started board flags background thread
2013-06-28 22:40:41 [INFO    ] Started BAM background thread
2013-06-28 22:40:41 [DEBUG   ] Finished updating ant stats in 1.099 seconds
2013-06-28 22:40:41 [INFO    ] Finished the INI process (ref. #49510) in 109.881 s
2013-06-28 22:40:42 [DEBUG   ] Finished updating board flags in 1.255 seconds
2013-06-28 22:41:01 [DEBUG   ] Finished updating ant stats in 0.970 seconds
2013-06-28 22:41:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 22:41:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 22:41:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2013-06-28 22:41:42 [DEBUG   ] Finished updating board flags in 1.191 seconds
2013-06-28 22:42:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 22:42:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 22:42:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 22:42:43 [DEBUG   ] Finished updating board flags in 2.078 seconds
2013-06-28 22:43:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 22:43:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 22:43:34 [DEBUG   ] Got command RPT from MCS: ref #49511
2013-06-28 22:43:34 [DEBUG   ] summary = ERROR
2013-06-28 22:43:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49511  13 56471 81814193 A  ERRORERROR'
2013-06-28 22:43:39 [DEBUG   ] Got command RPT from MCS: ref #49512
2013-06-28 22:43:39 [DEBUG   ] summary = ERROR
2013-06-28 22:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49512  13 56471 81819401 A  ERRORERROR'
2013-06-28 22:43:39 [DEBUG   ] Got command RPT from MCS: ref #49513
2013-06-28 22:43:39 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x06! Beamformer calibration failed
2013-06-28 22:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49513  72 56471 81819402 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x06! Beamformer calibration failed'
2013-06-28 22:43:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 22:43:42 [DEBUG   ] Got command RPT from MCS: ref #49529
2013-06-28 22:43:42 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x06! Beamformer calibration failed
2013-06-28 22:43:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49529  72 56471 81822185 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x06! Beamformer calibration failed'
2013-06-28 22:43:43 [DEBUG   ] Finished updating board flags in 2.023 seconds
2013-06-28 22:43:51 [DEBUG   ] Got command RPT from MCS: ref #49530
2013-06-28 22:43:51 [DEBUG   ] summary = ERROR
2013-06-28 22:43:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49530  13 56471 81831421 A  ERRORERROR'
2013-06-28 22:43:56 [DEBUG   ] Got command INI from MCS: ref #49531
2013-06-28 22:43:56 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2013-06-28 22:43:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    49531   8 56471 81836442 ABOOTING'
2013-06-28 22:44:17 [INFO    ] -------------------
2013-06-28 22:44:17 [INFO    ]  LWA board status
2013-06-28 22:44:17 [INFO    ] -------------------
2013-06-28 22:44:17 [INFO    ] DP 1: 2 lwa27
2013-06-28 22:44:17 [INFO    ] DP 1: 3 lwa24
2013-06-28 22:44:17 [INFO    ] DP 1: 4 lwa23
2013-06-28 22:44:17 [INFO    ] DP 1: 5 lwa18
2013-06-28 22:44:17 [INFO    ] DP 1: 6 lwa10
2013-06-28 22:44:17 [INFO    ] DP 1: 7 lwa32
2013-06-28 22:44:17 [INFO    ] DP 1: 8 lwa11
2013-06-28 22:44:17 [INFO    ] DP 1: 9 lwa30
2013-06-28 22:44:17 [INFO    ] DP 1: 10 lwa12
2013-06-28 22:44:17 [INFO    ] DP 1: 11 lwa8
2013-06-28 22:44:17 [INFO    ] DP 1: 12 lwa13
2013-06-28 22:44:17 [INFO    ] DP 1: 13 lwa26
2013-06-28 22:44:17 [INFO    ] DP 1: 14 lwa14
2013-06-28 22:44:17 [INFO    ] DP 1: 16 lwa22
2013-06-28 22:44:17 [INFO    ] DP 1: 17 lwa20
2013-06-28 22:44:17 [INFO    ] DP 1: 18 lwa1
2013-06-28 22:44:17 [INFO    ] DP 1: 19 lwa5
2013-06-28 22:44:17 [INFO    ] DP 1: 20 lwa25
2013-06-28 22:44:17 [INFO    ] DP 1: 21 lwa35
2013-06-28 22:44:17 [INFO    ] DP 1: 22 lwa19
2013-06-28 22:44:17 [INFO    ] DP 1: 23 lwa21
2013-06-28 22:44:17 [INFO    ] DP 1: 24 lwa6
2013-06-28 22:44:17 [INFO    ] DP 1: 25 lwa7
2013-06-28 22:44:17 [INFO    ] DP 1: 26 lwa33
2013-06-28 22:44:17 [INFO    ] DP 1: 27 lwa15
2013-06-28 22:44:17 [INFO    ] DP 1: 28 lwa28
2013-06-28 22:44:17 [INFO    ] DP 2: 1 lwa16
2013-06-28 22:44:17 [INFO    ] DP 2: 15 lwa34
2013-06-28 22:44:17 [INFO    ] Total of 28 boards
2013-06-28 22:44:17 [INFO    ] Total of 260 stands
2013-06-28 22:44:17 [INFO    ] -------------------
2013-06-28 22:44:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2013-06-28 22:44:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2013-06-28 22:44:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2013-06-28 22:44:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2013-06-28 22:44:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2013-06-28 22:44:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2013-06-28 22:44:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2013-06-28 22:44:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2013-06-28 22:44:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2013-06-28 22:44:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2013-06-28 22:44:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2013-06-28 22:44:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2013-06-28 22:44:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2013-06-28 22:44:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2013-06-28 22:44:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2013-06-28 22:44:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2013-06-28 22:44:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2013-06-28 22:44:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2013-06-28 22:44:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2013-06-28 22:44:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2013-06-28 22:44:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2013-06-28 22:44:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2013-06-28 22:44:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2013-06-28 22:44:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2013-06-28 22:44:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2013-06-28 22:44:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2013-06-28 22:44:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2013-06-28 22:44:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2013-06-28 22:44:24 [DEBUG   ] 2013-06-28 22:44:24 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14843
2013-06-28 22:44:24 [DEBUG   ] 2013-06-28 22:44:24 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14844
2013-06-28 22:44:24 [DEBUG   ] 2013-06-28 22:44:24 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14845
2013-06-28 22:44:24 [DEBUG   ] 2013-06-28 22:44:24 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14846
2013-06-28 22:44:24 [DEBUG   ] 2013-06-28 22:44:24 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14847
2013-06-28 22:44:24 [DEBUG   ] 2013-06-28 22:44:24 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14848
2013-06-28 22:44:24 [DEBUG   ] 2013-06-28 22:44:24 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14849
2013-06-28 22:44:24 [DEBUG   ] 2013-06-28 22:44:24 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14850
2013-06-28 22:44:24 [DEBUG   ] 2013-06-28 22:44:24 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14851
2013-06-28 22:44:24 [DEBUG   ] 2013-06-28 22:44:24 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14852
2013-06-28 22:44:24 [DEBUG   ] 2013-06-28 22:44:24 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14853
2013-06-28 22:44:24 [DEBUG   ] 2013-06-28 22:44:24 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14854
2013-06-28 22:44:24 [DEBUG   ] 2013-06-28 22:44:24 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14855
2013-06-28 22:44:24 [DEBUG   ] 2013-06-28 22:44:24 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14856
2013-06-28 22:44:24 [DEBUG   ] 2013-06-28 22:44:24 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14857
2013-06-28 22:44:24 [DEBUG   ] 2013-06-28 22:44:24 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14858
2013-06-28 22:44:24 [DEBUG   ] 2013-06-28 22:44:24 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14859
2013-06-28 22:44:24 [DEBUG   ] 2013-06-28 22:44:24 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14860
2013-06-28 22:44:24 [DEBUG   ] 2013-06-28 22:44:24 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14861
2013-06-28 22:44:24 [DEBUG   ] 2013-06-28 22:44:24 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14862
2013-06-28 22:44:24 [DEBUG   ] 2013-06-28 22:44:24 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14863
2013-06-28 22:44:24 [DEBUG   ] 2013-06-28 22:44:24 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14864
2013-06-28 22:44:24 [DEBUG   ] 2013-06-28 22:44:24 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14865
2013-06-28 22:44:24 [DEBUG   ] 2013-06-28 22:44:24 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14866
2013-06-28 22:44:24 [DEBUG   ] 2013-06-28 22:44:24 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14867
2013-06-28 22:44:24 [DEBUG   ] 2013-06-28 22:44:24 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14868
2013-06-28 22:44:36 [DEBUG   ] 2013-06-28 22:44:36 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14843 exited with status 0
2013-06-28 22:44:36 [DEBUG   ] 2013-06-28 22:44:36 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14844 exited with status 0
2013-06-28 22:44:36 [DEBUG   ] 2013-06-28 22:44:36 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14845 exited with status 0
2013-06-28 22:44:36 [DEBUG   ] 2013-06-28 22:44:36 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14846 exited with status 0
2013-06-28 22:44:36 [DEBUG   ] 2013-06-28 22:44:36 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14847 exited with status 0
2013-06-28 22:44:36 [DEBUG   ] 2013-06-28 22:44:36 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14848 exited with status 0
2013-06-28 22:44:36 [DEBUG   ] 2013-06-28 22:44:36 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14849 exited with status 0
2013-06-28 22:44:36 [DEBUG   ] 2013-06-28 22:44:36 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14850 exited with status 0
2013-06-28 22:44:36 [DEBUG   ] 2013-06-28 22:44:36 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14851 exited with status 0
2013-06-28 22:44:36 [DEBUG   ] 2013-06-28 22:44:36 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14852 exited with status 0
2013-06-28 22:44:36 [DEBUG   ] 2013-06-28 22:44:36 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14853 exited with status 0
2013-06-28 22:44:36 [DEBUG   ] 2013-06-28 22:44:36 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14854 exited with status 0
2013-06-28 22:44:36 [DEBUG   ] 2013-06-28 22:44:36 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14855 exited with status 0
2013-06-28 22:44:36 [DEBUG   ] 2013-06-28 22:44:36 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14856 exited with status 0
2013-06-28 22:44:36 [DEBUG   ] 2013-06-28 22:44:36 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14857 exited with status 0
2013-06-28 22:44:36 [DEBUG   ] 2013-06-28 22:44:36 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14858 exited with status 0
2013-06-28 22:44:36 [DEBUG   ] 2013-06-28 22:44:36 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14859 exited with status 0
2013-06-28 22:44:36 [DEBUG   ] 2013-06-28 22:44:36 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14860 exited with status 0
2013-06-28 22:44:36 [DEBUG   ] 2013-06-28 22:44:36 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14861 exited with status 0
2013-06-28 22:44:36 [DEBUG   ] 2013-06-28 22:44:36 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14862 exited with status 0
2013-06-28 22:44:36 [DEBUG   ] 2013-06-28 22:44:36 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14863 exited with status 0
2013-06-28 22:44:36 [DEBUG   ] 2013-06-28 22:44:36 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14864 exited with status 0
2013-06-28 22:44:36 [DEBUG   ] 2013-06-28 22:44:36 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14865 exited with status 0
2013-06-28 22:44:36 [DEBUG   ] 2013-06-28 22:44:36 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14866 exited with status 0
2013-06-28 22:44:36 [DEBUG   ] 2013-06-28 22:44:36 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14867 exited with status 0
2013-06-28 22:44:36 [DEBUG   ] 2013-06-28 22:44:36 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14868 exited with status 0
2013-06-28 22:44:36 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2013-06-28 22:44:36 [DEBUG   ] spawn_process: at 2013-06-28 22:44:36 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2013-06-28 22:44:36 [DEBUG   ] spawn_process: at 2013-06-28 22:44:36 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2013-06-28 22:44:36 [DEBUG   ] spawn_process: at 2013-06-28 22:44:36 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2013-06-28 22:44:36 [DEBUG   ] spawn_process: at 2013-06-28 22:44:36 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2013-06-28 22:44:36 [DEBUG   ] spawn_process: at 2013-06-28 22:44:36 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2013-06-28 22:44:36 [DEBUG   ] spawn_process: at 2013-06-28 22:44:36 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2013-06-28 22:44:36 [DEBUG   ] spawn_process: at 2013-06-28 22:44:36 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2013-06-28 22:44:36 [DEBUG   ] spawn_process: at 2013-06-28 22:44:36 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2013-06-28 22:44:36 [DEBUG   ] spawn_process: at 2013-06-28 22:44:36 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2013-06-28 22:44:36 [DEBUG   ] spawn_process: at 2013-06-28 22:44:36 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2013-06-28 22:44:36 [DEBUG   ] spawn_process: at 2013-06-28 22:44:36 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2013-06-28 22:44:36 [DEBUG   ] spawn_process: at 2013-06-28 22:44:36 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2013-06-28 22:44:36 [DEBUG   ] spawn_process: at 2013-06-28 22:44:36 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2013-06-28 22:44:36 [DEBUG   ] spawn_process: at 2013-06-28 22:44:36 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2013-06-28 22:44:36 [DEBUG   ] spawn_process: at 2013-06-28 22:44:36 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2013-06-28 22:44:36 [DEBUG   ] spawn_process: at 2013-06-28 22:44:36 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2013-06-28 22:44:36 [DEBUG   ] spawn_process: at 2013-06-28 22:44:36 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2013-06-28 22:44:36 [DEBUG   ] spawn_process: at 2013-06-28 22:44:36 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2013-06-28 22:44:36 [DEBUG   ] spawn_process: at 2013-06-28 22:44:36 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2013-06-28 22:44:36 [DEBUG   ] spawn_process: at 2013-06-28 22:44:36 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2013-06-28 22:44:36 [DEBUG   ] spawn_process: at 2013-06-28 22:44:36 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2013-06-28 22:44:36 [DEBUG   ] spawn_process: at 2013-06-28 22:44:36 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2013-06-28 22:44:36 [DEBUG   ] spawn_process: at 2013-06-28 22:44:36 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2013-06-28 22:44:36 [DEBUG   ] spawn_process: at 2013-06-28 22:44:36 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2013-06-28 22:44:36 [DEBUG   ] spawn_process: at 2013-06-28 22:44:36 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2013-06-28 22:44:36 [DEBUG   ] spawn_process: at 2013-06-28 22:44:36 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2013-06-28 22:44:36 [DEBUG   ] 2013-06-28 22:44:36 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 14895
2013-06-28 22:44:36 [DEBUG   ] 2013-06-28 22:44:36 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 14896
2013-06-28 22:44:42 [DEBUG   ] 2013-06-28 22:44:42 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 14895 exited with status 0
2013-06-28 22:44:42 [DEBUG   ] 2013-06-28 22:44:42 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 14896 exited with status 0
2013-06-28 22:44:42 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2013-06-28 22:44:42 [DEBUG   ] spawn_process: at 2013-06-28 22:44:42 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2013-06-28 22:44:42 [DEBUG   ] spawn_process: at 2013-06-28 22:44:42 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2013-06-28 22:44:42 [INFO    ] Setting Beam 1 xbars
2013-06-28 22:44:42 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2013-06-28 22:44:42 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2013-06-28 22:44:42 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2013-06-28 22:44:42 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2013-06-28 22:44:42 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2013-06-28 22:44:43 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2013-06-28 22:44:43 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2013-06-28 22:44:43 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2013-06-28 22:44:43 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2013-06-28 22:44:43 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2013-06-28 22:44:43 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2013-06-28 22:44:43 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2013-06-28 22:44:43 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2013-06-28 22:44:43 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2013-06-28 22:44:44 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2013-06-28 22:44:44 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2013-06-28 22:44:44 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2013-06-28 22:44:44 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2013-06-28 22:44:44 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2013-06-28 22:44:44 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2013-06-28 22:44:44 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2013-06-28 22:44:44 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2013-06-28 22:44:44 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2013-06-28 22:44:44 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2013-06-28 22:44:45 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2013-06-28 22:44:45 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2013-06-28 22:44:45 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2013-06-28 22:44:45 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2013-06-28 22:44:45 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2013-06-28 22:44:45 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2013-06-28 22:44:45 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2013-06-28 22:44:45 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2013-06-28 22:44:45 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2013-06-28 22:44:46 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2013-06-28 22:44:46 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2013-06-28 22:44:46 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2013-06-28 22:44:46 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2013-06-28 22:44:46 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2013-06-28 22:44:46 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2013-06-28 22:44:46 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2013-06-28 22:44:46 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2013-06-28 22:44:46 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2013-06-28 22:44:47 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2013-06-28 22:44:47 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2013-06-28 22:44:47 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2013-06-28 22:44:47 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2013-06-28 22:44:47 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2013-06-28 22:44:47 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2013-06-28 22:44:47 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2013-06-28 22:44:47 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2013-06-28 22:44:47 [INFO    ] Setting Beam 2 xbars
2013-06-28 22:44:47 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2013-06-28 22:44:48 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2013-06-28 22:44:48 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2013-06-28 22:44:48 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2013-06-28 22:44:48 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2013-06-28 22:44:48 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2013-06-28 22:44:48 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2013-06-28 22:44:48 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2013-06-28 22:44:48 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2013-06-28 22:44:48 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2013-06-28 22:44:49 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2013-06-28 22:44:49 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2013-06-28 22:44:49 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2013-06-28 22:44:49 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2013-06-28 22:44:49 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2013-06-28 22:44:49 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2013-06-28 22:44:49 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2013-06-28 22:44:49 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2013-06-28 22:44:49 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2013-06-28 22:44:50 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2013-06-28 22:44:50 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2013-06-28 22:44:50 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2013-06-28 22:44:50 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2013-06-28 22:44:50 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2013-06-28 22:44:50 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2013-06-28 22:44:50 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2013-06-28 22:44:50 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2013-06-28 22:44:50 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2013-06-28 22:44:51 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2013-06-28 22:44:51 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2013-06-28 22:44:51 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2013-06-28 22:44:51 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2013-06-28 22:44:51 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2013-06-28 22:44:51 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2013-06-28 22:44:51 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2013-06-28 22:44:51 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2013-06-28 22:44:51 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2013-06-28 22:44:51 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2013-06-28 22:44:52 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2013-06-28 22:44:52 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2013-06-28 22:44:52 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2013-06-28 22:44:52 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2013-06-28 22:44:52 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2013-06-28 22:44:52 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2013-06-28 22:44:52 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2013-06-28 22:44:52 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2013-06-28 22:44:52 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2013-06-28 22:44:53 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2013-06-28 22:44:53 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2013-06-28 22:44:53 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2013-06-28 22:44:53 [INFO    ] Setting Beam 3 xbars
2013-06-28 22:44:53 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2013-06-28 22:44:53 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2013-06-28 22:44:53 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2013-06-28 22:44:53 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2013-06-28 22:44:53 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2013-06-28 22:44:53 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2013-06-28 22:44:54 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2013-06-28 22:44:54 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2013-06-28 22:44:54 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2013-06-28 22:44:54 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2013-06-28 22:44:54 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2013-06-28 22:44:54 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2013-06-28 22:44:54 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2013-06-28 22:44:54 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2013-06-28 22:44:54 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2013-06-28 22:44:55 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2013-06-28 22:44:55 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2013-06-28 22:44:55 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2013-06-28 22:44:55 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2013-06-28 22:44:55 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2013-06-28 22:44:55 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2013-06-28 22:44:55 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2013-06-28 22:44:55 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2013-06-28 22:44:55 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2013-06-28 22:44:55 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2013-06-28 22:44:56 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2013-06-28 22:44:56 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2013-06-28 22:44:56 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2013-06-28 22:44:56 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2013-06-28 22:44:56 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2013-06-28 22:44:56 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2013-06-28 22:44:56 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2013-06-28 22:44:56 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2013-06-28 22:44:56 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2013-06-28 22:44:57 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2013-06-28 22:44:57 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2013-06-28 22:44:57 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2013-06-28 22:44:57 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2013-06-28 22:44:57 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2013-06-28 22:44:57 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2013-06-28 22:44:57 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2013-06-28 22:44:57 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2013-06-28 22:44:57 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2013-06-28 22:44:58 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2013-06-28 22:44:58 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2013-06-28 22:44:58 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2013-06-28 22:44:58 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2013-06-28 22:44:58 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2013-06-28 22:44:58 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2013-06-28 22:44:58 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2013-06-28 22:44:58 [INFO    ] Setting Beam 4 xbars
2013-06-28 22:44:58 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2013-06-28 22:44:58 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2013-06-28 22:44:59 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2013-06-28 22:44:59 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2013-06-28 22:44:59 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2013-06-28 22:44:59 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2013-06-28 22:44:59 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2013-06-28 22:44:59 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2013-06-28 22:44:59 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2013-06-28 22:44:59 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2013-06-28 22:44:59 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2013-06-28 22:44:59 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2013-06-28 22:45:00 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2013-06-28 22:45:00 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2013-06-28 22:45:00 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2013-06-28 22:45:00 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2013-06-28 22:45:00 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2013-06-28 22:45:00 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2013-06-28 22:45:00 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2013-06-28 22:45:00 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2013-06-28 22:45:00 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2013-06-28 22:45:01 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2013-06-28 22:45:01 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2013-06-28 22:45:01 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2013-06-28 22:45:01 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2013-06-28 22:45:01 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2013-06-28 22:45:01 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2013-06-28 22:45:01 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2013-06-28 22:45:01 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2013-06-28 22:45:01 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2013-06-28 22:45:02 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2013-06-28 22:45:02 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2013-06-28 22:45:02 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2013-06-28 22:45:02 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2013-06-28 22:45:02 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2013-06-28 22:45:02 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2013-06-28 22:45:02 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2013-06-28 22:45:02 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2013-06-28 22:45:02 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2013-06-28 22:45:03 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2013-06-28 22:45:03 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2013-06-28 22:45:03 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2013-06-28 22:45:03 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2013-06-28 22:45:03 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2013-06-28 22:45:03 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2013-06-28 22:45:03 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2013-06-28 22:45:03 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2013-06-28 22:45:03 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2013-06-28 22:45:03 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2013-06-28 22:45:04 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2013-06-28 22:45:04 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2013-06-28 22:45:04 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2013-06-28 22:45:04 [INFO    ] All xbars set
2013-06-28 22:45:04 [INFO    ] Setting adder chain routing for all beams
2013-06-28 22:45:07 [DEBUG   ] Got command RPT from MCS: ref #49532
2013-06-28 22:45:07 [DEBUG   ] summary = BOOTING
2013-06-28 22:45:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49532  15 56471 81907573 ABOOTINGBOOTING'
2013-06-28 22:45:09 [INFO    ] Setting beam ids
2013-06-28 22:45:12 [DEBUG   ] Got command RPT from MCS: ref #49533
2013-06-28 22:45:12 [DEBUG   ] summary = BOOTING
2013-06-28 22:45:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49533  15 56471 81912805 ABOOTINGBOOTING'
2013-06-28 22:45:20 [INFO    ] Starting beam delay calibration
2013-06-28 22:45:32 [INFO    ] Beam 1 latency is 5739
2013-06-28 22:45:32 [INFO    ] Beam 2 latency is 5760
2013-06-28 22:45:32 [INFO    ] Beam 3 latency is 5749
2013-06-28 22:45:32 [INFO    ] Beam 4 latency is 5733
2013-06-28 22:45:32 [INFO    ] Stop calibration
2013-06-28 22:45:38 [DEBUG   ] Got command RPT from MCS: ref #49534
2013-06-28 22:45:38 [DEBUG   ] summary = BOOTING
2013-06-28 22:45:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49534  15 56471 81938214 ABOOTINGBOOTING'
2013-06-28 22:45:39 [INFO    ] Beam delay calibration successful
2013-06-28 22:45:39 [INFO    ] Calibration passed
2013-06-28 22:45:39 [DEBUG   ] spawn_process: at 2013-06-28 22:45:39 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2013-06-28 22:45:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2013-06-28 22:45:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2013-06-28 22:45:40 [DEBUG   ] spawn_process: at 2013-06-28 22:45:40 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2013-06-28 22:45:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2013-06-28 22:45:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2013-06-28 22:45:40 [DEBUG   ] spawn_process: at 2013-06-28 22:45:40 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2013-06-28 22:45:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2013-06-28 22:45:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2013-06-28 22:45:40 [DEBUG   ] spawn_process: at 2013-06-28 22:45:40 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2013-06-28 22:45:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2013-06-28 22:45:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2013-06-28 22:45:40 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2013-06-28 22:45:40 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 338 ms (1372459540.341 s) with PID 16466 and time 1372459539
2013-06-28 22:45:40 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2013-06-28 22:45:41 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 77 ms (1372459541.079 s) with PID 16487 and time 1372459540
2013-06-28 22:45:42 [INFO    ] Started antennas statistics background thread
2013-06-28 22:45:42 [INFO    ] Started board flags background thread
2013-06-28 22:45:42 [INFO    ] Started BAM background thread
2013-06-28 22:45:42 [INFO    ] Finished the INI process (ref. #49531) in 105.757 s
2013-06-28 22:45:42 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-28 22:45:42 [DEBUG   ] Got command RPT from MCS: ref #49535
2013-06-28 22:45:42 [DEBUG   ] summary = NORMAL
2013-06-28 22:45:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49535  14 56471 81942553 A NORMALNORMAL'
2013-06-28 22:45:43 [DEBUG   ] Finished updating board flags in 1.347 seconds
2013-06-28 22:45:59 [DEBUG   ] Got command TBN from MCS: ref #49536
2013-06-28 22:45:59 [DEBUG   ] spawn_process: at 2013-06-28 22:45:59 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '1', '1372459561']
2013-06-28 22:45:59 [DEBUG   ] spawn_process: at 2013-06-28 22:45:59 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '2', '1372459561']
2013-06-28 22:45:59 [DEBUG   ] tbn = exited with status True, code 0x00
2013-06-28 22:45:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN    49536   8 56471 81959649 A NORMAL'
2013-06-28 22:45:59 [DEBUG   ] spawn_process: at 2013-06-28 22:45:59 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '3', '1372459561']
2013-06-28 22:45:59 [DEBUG   ] spawn_process: at 2013-06-28 22:45:59 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '4', '1372459561']
2013-06-28 22:45:59 [DEBUG   ] spawn_process: at 2013-06-28 22:45:59 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '5', '1372459561']
2013-06-28 22:45:59 [DEBUG   ] spawn_process: at 2013-06-28 22:45:59 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '6', '1372459561']
2013-06-28 22:45:59 [DEBUG   ] spawn_process: at 2013-06-28 22:45:59 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '7', '1372459561']
2013-06-28 22:45:59 [DEBUG   ] spawn_process: at 2013-06-28 22:45:59 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '8', '1372459561']
2013-06-28 22:45:59 [DEBUG   ] spawn_process: at 2013-06-28 22:45:59 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '9', '1372459561']
2013-06-28 22:45:59 [DEBUG   ] spawn_process: at 2013-06-28 22:45:59 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '10', '1372459561']
2013-06-28 22:45:59 [DEBUG   ] spawn_process: at 2013-06-28 22:45:59 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '11', '1372459561']
2013-06-28 22:45:59 [DEBUG   ] spawn_process: at 2013-06-28 22:45:59 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '12', '1372459561']
2013-06-28 22:45:59 [DEBUG   ] spawn_process: at 2013-06-28 22:45:59 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '13', '1372459561']
2013-06-28 22:45:59 [DEBUG   ] spawn_process: at 2013-06-28 22:45:59 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '14', '1372459561']
2013-06-28 22:45:59 [DEBUG   ] spawn_process: at 2013-06-28 22:45:59 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '15', '1372459561']
2013-06-28 22:45:59 [DEBUG   ] spawn_process: at 2013-06-28 22:45:59 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '16', '1372459561']
2013-06-28 22:45:59 [DEBUG   ] spawn_process: at 2013-06-28 22:45:59 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '17', '1372459561']
2013-06-28 22:45:59 [DEBUG   ] spawn_process: at 2013-06-28 22:45:59 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '18', '1372459561']
2013-06-28 22:45:59 [DEBUG   ] spawn_process: at 2013-06-28 22:45:59 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '19', '1372459561']
2013-06-28 22:45:59 [DEBUG   ] spawn_process: at 2013-06-28 22:45:59 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '20', '1372459561']
2013-06-28 22:45:59 [DEBUG   ] spawn_process: at 2013-06-28 22:45:59 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '21', '1372459561']
2013-06-28 22:45:59 [DEBUG   ] spawn_process: at 2013-06-28 22:45:59 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '22', '1372459561']
2013-06-28 22:45:59 [DEBUG   ] spawn_process: at 2013-06-28 22:45:59 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '23', '1372459561']
2013-06-28 22:45:59 [DEBUG   ] spawn_process: at 2013-06-28 22:45:59 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '24', '1372459561']
2013-06-28 22:45:59 [DEBUG   ] spawn_process: at 2013-06-28 22:45:59 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '25', '1372459561']
2013-06-28 22:45:59 [DEBUG   ] spawn_process: at 2013-06-28 22:45:59 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '26', '1372459561']
2013-06-28 22:45:59 [INFO    ] Finished spawning TBN in 0.046 s
2013-06-28 22:46:02 [DEBUG   ] Finished updating ant stats in 0.976 seconds
2013-06-28 22:46:22 [DEBUG   ] Finished updating ant stats in 0.865 seconds
2013-06-28 22:46:42 [DEBUG   ] Finished updating ant stats in 0.848 seconds
2013-06-28 22:46:43 [DEBUG   ] Finished updating board flags in 1.437 seconds
2013-06-28 22:47:02 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2013-06-28 22:47:22 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-28 22:47:42 [DEBUG   ] Finished updating ant stats in 0.429 seconds
2013-06-28 22:47:43 [DEBUG   ] Finished updating board flags in 1.380 seconds
2013-06-28 22:48:03 [DEBUG   ] Finished updating ant stats in 1.375 seconds
2013-06-28 22:48:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 22:48:39 [DEBUG   ] Got command RPT from MCS: ref #49537
2013-06-28 22:48:39 [DEBUG   ] summary = NORMAL
2013-06-28 22:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49537  14 56471 82119402 A NORMALNORMAL'
2013-06-28 22:48:39 [DEBUG   ] Got command RPT from MCS: ref #49538
2013-06-28 22:48:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-28 22:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49538  48 56471 82119402 A NORMALSystem calibrated and operating normally'
2013-06-28 22:48:43 [DEBUG   ] Finished updating ant stats in 1.247 seconds
2013-06-28 22:48:44 [DEBUG   ] Finished updating board flags in 2.220 seconds
2013-06-28 22:49:03 [DEBUG   ] Finished updating ant stats in 1.159 seconds
2013-06-28 22:49:23 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 22:49:43 [DEBUG   ] Finished updating ant stats in 1.048 seconds
2013-06-28 22:49:44 [DEBUG   ] Finished updating board flags in 2.183 seconds
2013-06-28 22:50:03 [DEBUG   ] Finished updating ant stats in 0.954 seconds
2013-06-28 22:50:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 22:50:43 [DEBUG   ] Finished updating ant stats in 0.849 seconds
2013-06-28 22:50:44 [DEBUG   ] Finished updating board flags in 2.018 seconds
2013-06-28 22:51:03 [DEBUG   ] Finished updating ant stats in 0.754 seconds
2013-06-28 22:51:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 22:51:43 [DEBUG   ] Finished updating ant stats in 0.650 seconds
2013-06-28 22:51:44 [DEBUG   ] Finished updating board flags in 1.990 seconds
2013-06-28 22:52:03 [DEBUG   ] Finished updating ant stats in 0.555 seconds
2013-06-28 22:52:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-28 22:52:43 [DEBUG   ] Finished updating ant stats in 0.448 seconds
2013-06-28 22:52:44 [DEBUG   ] Finished updating board flags in 1.813 seconds
2013-06-28 22:53:04 [DEBUG   ] Finished updating ant stats in 1.360 seconds
2013-06-28 22:53:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 22:53:39 [DEBUG   ] Got command RPT from MCS: ref #49554
2013-06-28 22:53:39 [DEBUG   ] summary = NORMAL
2013-06-28 22:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49554  14 56471 82419401 A NORMALNORMAL'
2013-06-28 22:53:39 [DEBUG   ] Got command RPT from MCS: ref #49555
2013-06-28 22:53:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-28 22:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49555  48 56471 82419402 A NORMALSystem calibrated and operating normally'
2013-06-28 22:53:44 [DEBUG   ] Finished updating ant stats in 1.245 seconds
2013-06-28 22:53:44 [DEBUG   ] Finished updating board flags in 1.861 seconds
2013-06-28 22:54:04 [DEBUG   ] Finished updating ant stats in 1.157 seconds
2013-06-28 22:54:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-28 22:54:44 [DEBUG   ] Finished updating ant stats in 1.041 seconds
2013-06-28 22:54:44 [DEBUG   ] Finished updating board flags in 1.784 seconds
2013-06-28 22:55:04 [DEBUG   ] Finished updating ant stats in 0.957 seconds
2013-06-28 22:55:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-28 22:55:44 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2013-06-28 22:55:44 [DEBUG   ] Finished updating board flags in 1.619 seconds
2013-06-28 22:56:04 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2013-06-28 22:56:24 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2013-06-28 22:56:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2013-06-28 22:56:44 [DEBUG   ] Finished updating board flags in 1.584 seconds
2013-06-28 22:56:45 [DEBUG   ] Finished updating ant stats in 1.391 seconds
2013-06-28 22:57:05 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-28 22:57:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 22:57:45 [DEBUG   ] Finished updating ant stats in 1.247 seconds
2013-06-28 22:57:45 [DEBUG   ] Finished updating board flags in 2.421 seconds
2013-06-28 22:58:05 [DEBUG   ] Finished updating ant stats in 1.159 seconds
2013-06-28 22:58:25 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2013-06-28 22:58:39 [DEBUG   ] Got command RPT from MCS: ref #49571
2013-06-28 22:58:39 [DEBUG   ] summary = NORMAL
2013-06-28 22:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49571  14 56471 82719409 A NORMALNORMAL'
2013-06-28 22:58:39 [DEBUG   ] Got command RPT from MCS: ref #49572
2013-06-28 22:58:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-28 22:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49572  48 56471 82719410 A NORMALSystem calibrated and operating normally'
2013-06-28 22:58:45 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2013-06-28 22:58:45 [DEBUG   ] Finished updating board flags in 2.407 seconds
2013-06-28 22:59:05 [DEBUG   ] Finished updating ant stats in 0.759 seconds
2013-06-28 22:59:25 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2013-06-28 22:59:45 [DEBUG   ] Finished updating ant stats in 0.444 seconds
2013-06-28 22:59:45 [DEBUG   ] Finished updating board flags in 2.383 seconds
2013-06-28 23:00:06 [DEBUG   ] Finished updating ant stats in 1.363 seconds
2013-06-28 23:00:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 23:00:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2013-06-28 23:00:45 [DEBUG   ] Finished updating board flags in 2.207 seconds
2013-06-28 23:00:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 23:01:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 23:01:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 23:01:45 [DEBUG   ] Finished updating board flags in 2.185 seconds
2013-06-28 23:01:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 23:02:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 23:02:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 23:02:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2013-06-28 23:02:45 [DEBUG   ] Finished updating board flags in 2.018 seconds
2013-06-28 23:02:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 23:03:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 23:03:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 23:03:39 [DEBUG   ] Got command RPT from MCS: ref #49588
2013-06-28 23:03:39 [DEBUG   ] summary = NORMAL
2013-06-28 23:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49588  14 56471 83019405 A NORMALNORMAL'
2013-06-28 23:03:39 [DEBUG   ] Got command RPT from MCS: ref #49589
2013-06-28 23:03:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-28 23:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49589  48 56471 83019406 A NORMALSystem calibrated and operating normally'
2013-06-28 23:03:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2013-06-28 23:03:45 [DEBUG   ] Finished updating board flags in 2.034 seconds
2013-06-28 23:03:46 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2013-06-28 23:04:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-28 23:04:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-28 23:04:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2013-06-28 23:04:45 [DEBUG   ] Finished updating board flags in 1.982 seconds
2013-06-28 23:04:46 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2013-06-28 23:05:06 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2013-06-28 23:05:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-28 23:05:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2013-06-28 23:05:45 [DEBUG   ] Finished updating board flags in 1.809 seconds
2013-06-28 23:05:46 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-28 23:06:06 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-28 23:06:26 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2013-06-28 23:06:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2013-06-28 23:06:45 [DEBUG   ] Finished updating board flags in 1.768 seconds
2013-06-28 23:06:47 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2013-06-28 23:07:07 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-28 23:07:27 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-28 23:07:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2013-06-28 23:07:45 [DEBUG   ] Finished updating board flags in 1.575 seconds
2013-06-28 23:07:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-28 23:08:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 23:08:27 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-28 23:08:39 [DEBUG   ] Got command RPT from MCS: ref #49605
2013-06-28 23:08:39 [DEBUG   ] summary = NORMAL
2013-06-28 23:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49605  14 56471 83319409 A NORMALNORMAL'
2013-06-28 23:08:39 [DEBUG   ] Got command RPT from MCS: ref #49606
2013-06-28 23:08:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-28 23:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49606  48 56471 83319410 A NORMALSystem calibrated and operating normally'
2013-06-28 23:08:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2013-06-28 23:08:45 [DEBUG   ] Finished updating board flags in 1.408 seconds
2013-06-28 23:08:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 23:09:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-28 23:09:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-28 23:09:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2013-06-28 23:09:45 [DEBUG   ] Finished updating board flags in 1.426 seconds
2013-06-28 23:09:47 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2013-06-28 23:09:48 [DEBUG   ] Got command SHT from MCS: ref #49622
2013-06-28 23:09:48 [DEBUG   ] Stopping antenna statistics
2013-06-28 23:09:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_SHT    49622   8 56471 83388813 ASHUTDWN'
2013-06-28 23:09:50 [DEBUG   ] Stopping beam statistics
2013-06-28 23:09:50 [DEBUG   ] Stopping monitoring flags
2013-06-28 23:09:50 [DEBUG   ] Stopping BAM updater
2013-06-28 23:09:50 [DEBUG   ] Stopping DRX time setter
2013-06-28 23:09:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-06-28 23:09:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-06-28 23:09:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-06-28 23:09:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-06-28 23:09:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-06-28 23:09:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-06-28 23:09:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-06-28 23:09:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-06-28 23:09:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-06-28 23:09:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-06-28 23:09:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-06-28 23:09:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-06-28 23:09:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-06-28 23:09:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-06-28 23:09:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-06-28 23:09:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-06-28 23:09:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-06-28 23:09:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-06-28 23:09:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-06-28 23:09:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-06-28 23:09:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-06-28 23:09:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-06-28 23:09:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-06-28 23:09:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-06-28 23:09:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-06-28 23:10:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-06-28 23:10:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-06-28 23:10:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-06-28 23:10:01 [DEBUG   ] run_process: at 2013-06-28 23:10:01 running ['/usr/local/bin/lwa16', '/lwa/software/Shutdown.sh']
2013-06-28 23:10:01 [DEBUG   ] run_process: at 2013-06-28 23:10:01 running ['/usr/local/bin/lwa27', '/lwa/software/Shutdown.sh']
2013-06-28 23:10:01 [DEBUG   ] run_process: at 2013-06-28 23:10:01 running ['/usr/local/bin/lwa24', '/lwa/software/Shutdown.sh']
2013-06-28 23:10:01 [DEBUG   ] run_process: at 2013-06-28 23:10:01 running ['/usr/local/bin/lwa23', '/lwa/software/Shutdown.sh']
2013-06-28 23:10:01 [DEBUG   ] run_process: at 2013-06-28 23:10:01 running ['/usr/local/bin/lwa18', '/lwa/software/Shutdown.sh']
2013-06-28 23:10:01 [DEBUG   ] run_process: at 2013-06-28 23:10:01 running ['/usr/local/bin/lwa10', '/lwa/software/Shutdown.sh']
2013-06-28 23:10:01 [DEBUG   ] run_process: at 2013-06-28 23:10:01 running ['/usr/local/bin/lwa32', '/lwa/software/Shutdown.sh']
2013-06-28 23:10:02 [DEBUG   ] run_process: at 2013-06-28 23:10:02 running ['/usr/local/bin/lwa11', '/lwa/software/Shutdown.sh']
2013-06-28 23:10:02 [DEBUG   ] run_process: at 2013-06-28 23:10:02 running ['/usr/local/bin/lwa30', '/lwa/software/Shutdown.sh']
2013-06-28 23:10:02 [DEBUG   ] run_process: at 2013-06-28 23:10:02 running ['/usr/local/bin/lwa12', '/lwa/software/Shutdown.sh']
2013-06-28 23:10:02 [DEBUG   ] run_process: at 2013-06-28 23:10:02 running ['/usr/local/bin/lwa8', '/lwa/software/Shutdown.sh']
2013-06-28 23:10:02 [DEBUG   ] run_process: at 2013-06-28 23:10:02 running ['/usr/local/bin/lwa13', '/lwa/software/Shutdown.sh']
2013-06-28 23:10:02 [DEBUG   ] run_process: at 2013-06-28 23:10:02 running ['/usr/local/bin/lwa26', '/lwa/software/Shutdown.sh']
2013-06-28 23:10:02 [DEBUG   ] run_process: at 2013-06-28 23:10:02 running ['/usr/local/bin/lwa14', '/lwa/software/Shutdown.sh']
2013-06-28 23:10:02 [DEBUG   ] run_process: at 2013-06-28 23:10:02 running ['/usr/local/bin/lwa34', '/lwa/software/Shutdown.sh']
2013-06-28 23:10:02 [DEBUG   ] run_process: at 2013-06-28 23:10:02 running ['/usr/local/bin/lwa22', '/lwa/software/Shutdown.sh']
2013-06-28 23:10:03 [DEBUG   ] run_process: at 2013-06-28 23:10:03 running ['/usr/local/bin/lwa20', '/lwa/software/Shutdown.sh']
2013-06-28 23:10:03 [DEBUG   ] run_process: at 2013-06-28 23:10:03 running ['/usr/local/bin/lwa1', '/lwa/software/Shutdown.sh']
2013-06-28 23:10:03 [DEBUG   ] run_process: at 2013-06-28 23:10:03 running ['/usr/local/bin/lwa5', '/lwa/software/Shutdown.sh']
2013-06-28 23:10:03 [DEBUG   ] run_process: at 2013-06-28 23:10:03 running ['/usr/local/bin/lwa25', '/lwa/software/Shutdown.sh']
2013-06-28 23:10:03 [DEBUG   ] run_process: at 2013-06-28 23:10:03 running ['/usr/local/bin/lwa35', '/lwa/software/Shutdown.sh']
2013-06-28 23:10:03 [DEBUG   ] run_process: at 2013-06-28 23:10:03 running ['/usr/local/bin/lwa19', '/lwa/software/Shutdown.sh']
2013-06-28 23:10:03 [DEBUG   ] run_process: at 2013-06-28 23:10:03 running ['/usr/local/bin/lwa21', '/lwa/software/Shutdown.sh']
2013-06-28 23:10:03 [DEBUG   ] run_process: at 2013-06-28 23:10:03 running ['/usr/local/bin/lwa6', '/lwa/software/Shutdown.sh']
2013-06-28 23:10:04 [DEBUG   ] run_process: at 2013-06-28 23:10:04 running ['/usr/local/bin/lwa7', '/lwa/software/Shutdown.sh']
2013-06-28 23:10:04 [DEBUG   ] run_process: at 2013-06-28 23:10:04 running ['/usr/local/bin/lwa33', '/lwa/software/Shutdown.sh']
2013-06-28 23:10:04 [DEBUG   ] run_process: at 2013-06-28 23:10:04 running ['/usr/local/bin/lwa15', '/lwa/software/Shutdown.sh']
2013-06-28 23:10:04 [DEBUG   ] run_process: at 2013-06-28 23:10:04 running ['/usr/local/bin/lwa28', '/lwa/software/Shutdown.sh']
2013-06-28 23:10:04 [INFO    ] Finished the SHT process in 15.644 s
2013-06-28 23:13:39 [DEBUG   ] Got command RPT from MCS: ref #49624
2013-06-28 23:13:39 [DEBUG   ] summary = SHUTDWN
2013-06-28 23:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49624  15 56471 83619413 ASHUTDWNSHUTDWN'
2013-06-28 23:13:39 [DEBUG   ] Got command RPT from MCS: ref #49625
2013-06-28 23:13:39 [DEBUG   ] info = System has been shut down
2013-06-28 23:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49625  33 56471 83619414 ASHUTDWNSystem has been shut down'
2013-06-28 23:18:39 [DEBUG   ] Got command RPT from MCS: ref #49641
2013-06-28 23:18:39 [DEBUG   ] summary = SHUTDWN
2013-06-28 23:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49641  15 56471 83919409 ASHUTDWNSHUTDWN'
2013-06-28 23:18:39 [DEBUG   ] Got command RPT from MCS: ref #49642
2013-06-28 23:18:39 [DEBUG   ] info = System has been shut down
2013-06-28 23:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49642  33 56471 83919410 ASHUTDWNSystem has been shut down'
2013-06-28 23:23:39 [DEBUG   ] Got command RPT from MCS: ref #49658
2013-06-28 23:23:39 [DEBUG   ] summary = SHUTDWN
2013-06-28 23:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49658  15 56471 84219413 ASHUTDWNSHUTDWN'
2013-06-28 23:23:39 [DEBUG   ] Got command RPT from MCS: ref #49659
2013-06-28 23:23:39 [DEBUG   ] info = System has been shut down
2013-06-28 23:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49659  33 56471 84219414 ASHUTDWNSystem has been shut down'
2013-06-28 23:28:39 [DEBUG   ] Got command RPT from MCS: ref #49675
2013-06-28 23:28:39 [DEBUG   ] summary = SHUTDWN
2013-06-28 23:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49675  15 56471 84519409 ASHUTDWNSHUTDWN'
2013-06-28 23:28:39 [DEBUG   ] Got command RPT from MCS: ref #49676
2013-06-28 23:28:39 [DEBUG   ] info = System has been shut down
2013-06-28 23:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49676  33 56471 84519410 ASHUTDWNSystem has been shut down'
2013-06-28 23:33:39 [DEBUG   ] Got command RPT from MCS: ref #49692
2013-06-28 23:33:39 [DEBUG   ] summary = SHUTDWN
2013-06-28 23:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49692  15 56471 84819417 ASHUTDWNSHUTDWN'
2013-06-28 23:33:39 [DEBUG   ] Got command RPT from MCS: ref #49693
2013-06-28 23:33:39 [DEBUG   ] info = System has been shut down
2013-06-28 23:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49693  33 56471 84819418 ASHUTDWNSystem has been shut down'
2013-06-28 23:38:39 [DEBUG   ] Got command RPT from MCS: ref #49709
2013-06-28 23:38:39 [DEBUG   ] summary = SHUTDWN
2013-06-28 23:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49709  15 56471 85119421 ASHUTDWNSHUTDWN'
2013-06-28 23:38:39 [DEBUG   ] Got command RPT from MCS: ref #49710
2013-06-28 23:38:39 [DEBUG   ] info = System has been shut down
2013-06-28 23:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49710  33 56471 85119422 ASHUTDWNSystem has been shut down'
2013-06-28 23:43:39 [DEBUG   ] Got command RPT from MCS: ref #49726
2013-06-28 23:43:39 [DEBUG   ] summary = SHUTDWN
2013-06-28 23:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49726  15 56471 85419413 ASHUTDWNSHUTDWN'
2013-06-28 23:43:39 [DEBUG   ] Got command RPT from MCS: ref #49727
2013-06-28 23:43:39 [DEBUG   ] info = System has been shut down
2013-06-28 23:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49727  33 56471 85419414 ASHUTDWNSystem has been shut down'
2013-06-28 23:48:39 [DEBUG   ] Got command RPT from MCS: ref #49743
2013-06-28 23:48:39 [DEBUG   ] summary = SHUTDWN
2013-06-28 23:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49743  15 56471 85719417 ASHUTDWNSHUTDWN'
2013-06-28 23:48:39 [DEBUG   ] Got command RPT from MCS: ref #49744
2013-06-28 23:48:39 [DEBUG   ] info = System has been shut down
2013-06-28 23:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49744  33 56471 85719418 ASHUTDWNSystem has been shut down'
2013-06-28 23:53:39 [DEBUG   ] Got command RPT from MCS: ref #49760
2013-06-28 23:53:39 [DEBUG   ] summary = SHUTDWN
2013-06-28 23:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49760  15 56471 86019421 ASHUTDWNSHUTDWN'
2013-06-28 23:53:39 [DEBUG   ] Got command RPT from MCS: ref #49761
2013-06-28 23:53:39 [DEBUG   ] info = System has been shut down
2013-06-28 23:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49761  33 56471 86019422 ASHUTDWNSystem has been shut down'
2013-06-28 23:58:39 [DEBUG   ] Got command RPT from MCS: ref #49777
2013-06-28 23:58:39 [DEBUG   ] summary = SHUTDWN
2013-06-28 23:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49777  15 56471 86319417 ASHUTDWNSHUTDWN'
2013-06-28 23:58:39 [DEBUG   ] Got command RPT from MCS: ref #49778
2013-06-28 23:58:39 [DEBUG   ] info = System has been shut down
2013-06-28 23:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49778  33 56471 86319418 ASHUTDWNSystem has been shut down'
2013-06-29 00:03:39 [DEBUG   ] Got command RPT from MCS: ref #49794
2013-06-29 00:03:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 00:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49794  15 56472   219417 ASHUTDWNSHUTDWN'
2013-06-29 00:03:39 [DEBUG   ] Got command RPT from MCS: ref #49795
2013-06-29 00:03:39 [DEBUG   ] info = System has been shut down
2013-06-29 00:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49795  33 56472   219418 ASHUTDWNSystem has been shut down'
2013-06-29 00:08:39 [DEBUG   ] Got command RPT from MCS: ref #49811
2013-06-29 00:08:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 00:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49811  15 56472   519421 ASHUTDWNSHUTDWN'
2013-06-29 00:08:39 [DEBUG   ] Got command RPT from MCS: ref #49812
2013-06-29 00:08:39 [DEBUG   ] info = System has been shut down
2013-06-29 00:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49812  33 56472   519422 ASHUTDWNSystem has been shut down'
2013-06-29 00:13:39 [DEBUG   ] Got command RPT from MCS: ref #49828
2013-06-29 00:13:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 00:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49828  15 56472   819425 ASHUTDWNSHUTDWN'
2013-06-29 00:13:39 [DEBUG   ] Got command RPT from MCS: ref #49829
2013-06-29 00:13:39 [DEBUG   ] info = System has been shut down
2013-06-29 00:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49829  33 56472   819426 ASHUTDWNSystem has been shut down'
2013-06-29 00:18:39 [DEBUG   ] Got command RPT from MCS: ref #49845
2013-06-29 00:18:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 00:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49845  15 56472  1119425 ASHUTDWNSHUTDWN'
2013-06-29 00:18:39 [DEBUG   ] Got command RPT from MCS: ref #49846
2013-06-29 00:18:39 [DEBUG   ] info = System has been shut down
2013-06-29 00:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49846  33 56472  1119426 ASHUTDWNSystem has been shut down'
2013-06-29 00:23:39 [DEBUG   ] Got command RPT from MCS: ref #49862
2013-06-29 00:23:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 00:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49862  15 56472  1419425 ASHUTDWNSHUTDWN'
2013-06-29 00:23:39 [DEBUG   ] Got command RPT from MCS: ref #49863
2013-06-29 00:23:39 [DEBUG   ] info = System has been shut down
2013-06-29 00:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49863  33 56472  1419426 ASHUTDWNSystem has been shut down'
2013-06-29 00:28:39 [DEBUG   ] Got command RPT from MCS: ref #49879
2013-06-29 00:28:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 00:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49879  15 56472  1719425 ASHUTDWNSHUTDWN'
2013-06-29 00:28:39 [DEBUG   ] Got command RPT from MCS: ref #49880
2013-06-29 00:28:39 [DEBUG   ] info = System has been shut down
2013-06-29 00:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49880  33 56472  1719426 ASHUTDWNSystem has been shut down'
2013-06-29 00:33:39 [DEBUG   ] Got command RPT from MCS: ref #49896
2013-06-29 00:33:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 00:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49896  15 56472  2019429 ASHUTDWNSHUTDWN'
2013-06-29 00:33:39 [DEBUG   ] Got command RPT from MCS: ref #49897
2013-06-29 00:33:39 [DEBUG   ] info = System has been shut down
2013-06-29 00:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49897  33 56472  2019430 ASHUTDWNSystem has been shut down'
2013-06-29 00:38:39 [DEBUG   ] Got command RPT from MCS: ref #49913
2013-06-29 00:38:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 00:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49913  15 56472  2319429 ASHUTDWNSHUTDWN'
2013-06-29 00:38:39 [DEBUG   ] Got command RPT from MCS: ref #49914
2013-06-29 00:38:39 [DEBUG   ] info = System has been shut down
2013-06-29 00:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49914  33 56472  2319430 ASHUTDWNSystem has been shut down'
2013-06-29 00:43:39 [DEBUG   ] Got command RPT from MCS: ref #49930
2013-06-29 00:43:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 00:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49930  15 56472  2619429 ASHUTDWNSHUTDWN'
2013-06-29 00:43:39 [DEBUG   ] Got command RPT from MCS: ref #49931
2013-06-29 00:43:39 [DEBUG   ] info = System has been shut down
2013-06-29 00:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49931  33 56472  2619430 ASHUTDWNSystem has been shut down'
2013-06-29 00:48:39 [DEBUG   ] Got command RPT from MCS: ref #49947
2013-06-29 00:48:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 00:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49947  15 56472  2919430 ASHUTDWNSHUTDWN'
2013-06-29 00:48:39 [DEBUG   ] Got command RPT from MCS: ref #49948
2013-06-29 00:48:39 [DEBUG   ] info = System has been shut down
2013-06-29 00:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49948  33 56472  2919430 ASHUTDWNSystem has been shut down'
2013-06-29 00:53:39 [DEBUG   ] Got command RPT from MCS: ref #49964
2013-06-29 00:53:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 00:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49964  15 56472  3219437 ASHUTDWNSHUTDWN'
2013-06-29 00:53:39 [DEBUG   ] Got command RPT from MCS: ref #49965
2013-06-29 00:53:39 [DEBUG   ] info = System has been shut down
2013-06-29 00:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49965  33 56472  3219438 ASHUTDWNSystem has been shut down'
2013-06-29 00:58:39 [DEBUG   ] Got command RPT from MCS: ref #49981
2013-06-29 00:58:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 00:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49981  15 56472  3519437 ASHUTDWNSHUTDWN'
2013-06-29 00:58:39 [DEBUG   ] Got command RPT from MCS: ref #49982
2013-06-29 00:58:39 [DEBUG   ] info = System has been shut down
2013-06-29 00:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49982  33 56472  3519438 ASHUTDWNSystem has been shut down'
2013-06-29 01:03:39 [DEBUG   ] Got command RPT from MCS: ref #49998
2013-06-29 01:03:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 01:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49998  15 56472  3819433 ASHUTDWNSHUTDWN'
2013-06-29 01:03:39 [DEBUG   ] Got command RPT from MCS: ref #49999
2013-06-29 01:03:39 [DEBUG   ] info = System has been shut down
2013-06-29 01:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    49999  33 56472  3819434 ASHUTDWNSystem has been shut down'
2013-06-29 01:08:39 [DEBUG   ] Got command RPT from MCS: ref #50015
2013-06-29 01:08:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 01:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50015  15 56472  4119433 ASHUTDWNSHUTDWN'
2013-06-29 01:08:39 [DEBUG   ] Got command RPT from MCS: ref #50016
2013-06-29 01:08:39 [DEBUG   ] info = System has been shut down
2013-06-29 01:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50016  33 56472  4119434 ASHUTDWNSystem has been shut down'
2013-06-29 01:13:39 [DEBUG   ] Got command RPT from MCS: ref #50032
2013-06-29 01:13:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 01:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50032  15 56472  4419437 ASHUTDWNSHUTDWN'
2013-06-29 01:13:39 [DEBUG   ] Got command RPT from MCS: ref #50033
2013-06-29 01:13:39 [DEBUG   ] info = System has been shut down
2013-06-29 01:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50033  33 56472  4419438 ASHUTDWNSystem has been shut down'
2013-06-29 01:18:39 [DEBUG   ] Got command RPT from MCS: ref #50049
2013-06-29 01:18:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 01:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50049  15 56472  4719445 ASHUTDWNSHUTDWN'
2013-06-29 01:18:39 [DEBUG   ] Got command RPT from MCS: ref #50050
2013-06-29 01:18:39 [DEBUG   ] info = System has been shut down
2013-06-29 01:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50050  33 56472  4719446 ASHUTDWNSystem has been shut down'
2013-06-29 01:23:39 [DEBUG   ] Got command RPT from MCS: ref #50066
2013-06-29 01:23:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 01:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50066  15 56472  5019437 ASHUTDWNSHUTDWN'
2013-06-29 01:23:39 [DEBUG   ] Got command RPT from MCS: ref #50067
2013-06-29 01:23:39 [DEBUG   ] info = System has been shut down
2013-06-29 01:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50067  33 56472  5019438 ASHUTDWNSystem has been shut down'
2013-06-29 01:28:39 [DEBUG   ] Got command RPT from MCS: ref #50083
2013-06-29 01:28:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 01:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50083  15 56472  5319445 ASHUTDWNSHUTDWN'
2013-06-29 01:28:39 [DEBUG   ] Got command RPT from MCS: ref #50084
2013-06-29 01:28:39 [DEBUG   ] info = System has been shut down
2013-06-29 01:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50084  33 56472  5319446 ASHUTDWNSystem has been shut down'
2013-06-29 01:33:39 [DEBUG   ] Got command RPT from MCS: ref #50100
2013-06-29 01:33:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 01:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50100  15 56472  5619437 ASHUTDWNSHUTDWN'
2013-06-29 01:33:39 [DEBUG   ] Got command RPT from MCS: ref #50101
2013-06-29 01:33:39 [DEBUG   ] info = System has been shut down
2013-06-29 01:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50101  33 56472  5619438 ASHUTDWNSystem has been shut down'
2013-06-29 01:38:39 [DEBUG   ] Got command RPT from MCS: ref #50117
2013-06-29 01:38:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 01:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50117  15 56472  5919438 ASHUTDWNSHUTDWN'
2013-06-29 01:38:39 [DEBUG   ] Got command RPT from MCS: ref #50118
2013-06-29 01:38:39 [DEBUG   ] info = System has been shut down
2013-06-29 01:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50118  33 56472  5919438 ASHUTDWNSystem has been shut down'
2013-06-29 01:43:39 [DEBUG   ] Got command RPT from MCS: ref #50134
2013-06-29 01:43:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 01:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50134  15 56472  6219449 ASHUTDWNSHUTDWN'
2013-06-29 01:43:39 [DEBUG   ] Got command RPT from MCS: ref #50135
2013-06-29 01:43:39 [DEBUG   ] info = System has been shut down
2013-06-29 01:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50135  33 56472  6219450 ASHUTDWNSystem has been shut down'
2013-06-29 01:48:39 [DEBUG   ] Got command RPT from MCS: ref #50151
2013-06-29 01:48:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 01:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50151  15 56472  6519449 ASHUTDWNSHUTDWN'
2013-06-29 01:48:39 [DEBUG   ] Got command RPT from MCS: ref #50152
2013-06-29 01:48:39 [DEBUG   ] info = System has been shut down
2013-06-29 01:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50152  33 56472  6519450 ASHUTDWNSystem has been shut down'
2013-06-29 01:53:39 [DEBUG   ] Got command RPT from MCS: ref #50168
2013-06-29 01:53:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 01:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50168  15 56472  6819449 ASHUTDWNSHUTDWN'
2013-06-29 01:53:39 [DEBUG   ] Got command RPT from MCS: ref #50169
2013-06-29 01:53:39 [DEBUG   ] info = System has been shut down
2013-06-29 01:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50169  33 56472  6819450 ASHUTDWNSystem has been shut down'
2013-06-29 01:58:39 [DEBUG   ] Got command RPT from MCS: ref #50185
2013-06-29 01:58:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 01:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50185  15 56472  7119449 ASHUTDWNSHUTDWN'
2013-06-29 01:58:39 [DEBUG   ] Got command RPT from MCS: ref #50186
2013-06-29 01:58:39 [DEBUG   ] info = System has been shut down
2013-06-29 01:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50186  33 56472  7119450 ASHUTDWNSystem has been shut down'
2013-06-29 02:03:39 [DEBUG   ] Got command RPT from MCS: ref #50202
2013-06-29 02:03:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 02:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50202  15 56472  7419446 ASHUTDWNSHUTDWN'
2013-06-29 02:03:39 [DEBUG   ] Got command RPT from MCS: ref #50203
2013-06-29 02:03:39 [DEBUG   ] info = System has been shut down
2013-06-29 02:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50203  33 56472  7419446 ASHUTDWNSystem has been shut down'
2013-06-29 02:08:39 [DEBUG   ] Got command RPT from MCS: ref #50223
2013-06-29 02:08:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 02:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50223  15 56472  7719446 ASHUTDWNSHUTDWN'
2013-06-29 02:08:39 [DEBUG   ] Got command RPT from MCS: ref #50224
2013-06-29 02:08:39 [DEBUG   ] info = System has been shut down
2013-06-29 02:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50224  33 56472  7719446 ASHUTDWNSystem has been shut down'
2013-06-29 02:13:39 [DEBUG   ] Got command RPT from MCS: ref #50255
2013-06-29 02:13:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 02:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50255  15 56472  8019446 ASHUTDWNSHUTDWN'
2013-06-29 02:13:39 [DEBUG   ] Got command RPT from MCS: ref #50256
2013-06-29 02:13:39 [DEBUG   ] info = System has been shut down
2013-06-29 02:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50256  33 56472  8019446 ASHUTDWNSystem has been shut down'
2013-06-29 02:18:39 [DEBUG   ] Got command RPT from MCS: ref #50272
2013-06-29 02:18:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 02:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50272  15 56472  8319446 ASHUTDWNSHUTDWN'
2013-06-29 02:18:39 [DEBUG   ] Got command RPT from MCS: ref #50273
2013-06-29 02:18:39 [DEBUG   ] info = System has been shut down
2013-06-29 02:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50273  33 56472  8319446 ASHUTDWNSystem has been shut down'
2013-06-29 02:23:39 [DEBUG   ] Got command RPT from MCS: ref #50289
2013-06-29 02:23:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 02:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50289  15 56472  8619457 ASHUTDWNSHUTDWN'
2013-06-29 02:23:39 [DEBUG   ] Got command RPT from MCS: ref #50290
2013-06-29 02:23:39 [DEBUG   ] info = System has been shut down
2013-06-29 02:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50290  33 56472  8619458 ASHUTDWNSystem has been shut down'
2013-06-29 02:28:39 [DEBUG   ] Got command RPT from MCS: ref #50306
2013-06-29 02:28:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 02:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50306  15 56472  8919457 ASHUTDWNSHUTDWN'
2013-06-29 02:28:39 [DEBUG   ] Got command RPT from MCS: ref #50307
2013-06-29 02:28:39 [DEBUG   ] info = System has been shut down
2013-06-29 02:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50307  33 56472  8919458 ASHUTDWNSystem has been shut down'
2013-06-29 02:33:39 [DEBUG   ] Got command RPT from MCS: ref #50323
2013-06-29 02:33:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 02:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50323  15 56472  9219457 ASHUTDWNSHUTDWN'
2013-06-29 02:33:39 [DEBUG   ] Got command RPT from MCS: ref #50324
2013-06-29 02:33:39 [DEBUG   ] info = System has been shut down
2013-06-29 02:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50324  33 56472  9219458 ASHUTDWNSystem has been shut down'
2013-06-29 02:38:39 [DEBUG   ] Got command RPT from MCS: ref #50340
2013-06-29 02:38:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 02:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50340  15 56472  9519457 ASHUTDWNSHUTDWN'
2013-06-29 02:38:39 [DEBUG   ] Got command RPT from MCS: ref #50341
2013-06-29 02:38:39 [DEBUG   ] info = System has been shut down
2013-06-29 02:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50341  33 56472  9519458 ASHUTDWNSystem has been shut down'
2013-06-29 02:43:39 [DEBUG   ] Got command RPT from MCS: ref #50357
2013-06-29 02:43:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 02:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50357  15 56472  9819457 ASHUTDWNSHUTDWN'
2013-06-29 02:43:39 [DEBUG   ] Got command RPT from MCS: ref #50358
2013-06-29 02:43:39 [DEBUG   ] info = System has been shut down
2013-06-29 02:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50358  33 56472  9819458 ASHUTDWNSystem has been shut down'
2013-06-29 02:48:39 [DEBUG   ] Got command RPT from MCS: ref #50374
2013-06-29 02:48:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 02:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50374  15 56472 10119461 ASHUTDWNSHUTDWN'
2013-06-29 02:48:39 [DEBUG   ] Got command RPT from MCS: ref #50375
2013-06-29 02:48:39 [DEBUG   ] info = System has been shut down
2013-06-29 02:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50375  33 56472 10119462 ASHUTDWNSystem has been shut down'
2013-06-29 02:53:39 [DEBUG   ] Got command RPT from MCS: ref #50391
2013-06-29 02:53:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 02:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50391  15 56472 10419461 ASHUTDWNSHUTDWN'
2013-06-29 02:53:39 [DEBUG   ] Got command RPT from MCS: ref #50392
2013-06-29 02:53:39 [DEBUG   ] info = System has been shut down
2013-06-29 02:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50392  33 56472 10419462 ASHUTDWNSystem has been shut down'
2013-06-29 02:58:39 [DEBUG   ] Got command RPT from MCS: ref #50408
2013-06-29 02:58:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 02:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50408  15 56472 10719461 ASHUTDWNSHUTDWN'
2013-06-29 02:58:39 [DEBUG   ] Got command RPT from MCS: ref #50409
2013-06-29 02:58:39 [DEBUG   ] info = System has been shut down
2013-06-29 02:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50409  33 56472 10719462 ASHUTDWNSystem has been shut down'
2013-06-29 03:03:39 [DEBUG   ] Got command RPT from MCS: ref #50425
2013-06-29 03:03:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 03:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50425  15 56472 11019465 ASHUTDWNSHUTDWN'
2013-06-29 03:03:39 [DEBUG   ] Got command RPT from MCS: ref #50426
2013-06-29 03:03:39 [DEBUG   ] info = System has been shut down
2013-06-29 03:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50426  33 56472 11019466 ASHUTDWNSystem has been shut down'
2013-06-29 03:08:39 [DEBUG   ] Got command RPT from MCS: ref #50450
2013-06-29 03:08:39 [DEBUG   ] summary = SHUTDWN
2013-06-29 03:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50450  15 56472 11319465 ASHUTDWNSHUTDWN'
2013-06-29 03:08:39 [DEBUG   ] Got command RPT from MCS: ref #50451
2013-06-29 03:08:39 [DEBUG   ] info = System has been shut down
2013-06-29 03:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50451  33 56472 11319466 ASHUTDWNSystem has been shut down'
2013-06-29 03:11:00 [DEBUG   ] Got command INI from MCS: ref #50467
2013-06-29 03:11:00 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2013-06-29 03:11:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    50467   8 56472 11460758 ABOOTING'
2013-06-29 03:11:14 [DEBUG   ] Got command RPT from MCS: ref #50468
2013-06-29 03:11:14 [DEBUG   ] summary = BOOTING
2013-06-29 03:11:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50468  15 56472 11474222 ABOOTINGBOOTING'
2013-06-29 03:11:20 [INFO    ] -------------------
2013-06-29 03:11:20 [INFO    ]  LWA board status
2013-06-29 03:11:20 [INFO    ] -------------------
2013-06-29 03:11:20 [INFO    ] DP 1: 2 lwa27
2013-06-29 03:11:20 [INFO    ] DP 1: 3 lwa24
2013-06-29 03:11:20 [INFO    ] DP 1: 4 lwa23
2013-06-29 03:11:20 [INFO    ] DP 1: 5 lwa18
2013-06-29 03:11:20 [INFO    ] DP 1: 6 lwa10
2013-06-29 03:11:20 [INFO    ] DP 1: 7 lwa32
2013-06-29 03:11:20 [INFO    ] DP 1: 8 lwa11
2013-06-29 03:11:20 [INFO    ] DP 1: 9 lwa30
2013-06-29 03:11:20 [INFO    ] DP 1: 10 lwa12
2013-06-29 03:11:20 [INFO    ] DP 1: 11 lwa8
2013-06-29 03:11:20 [INFO    ] DP 1: 12 lwa13
2013-06-29 03:11:20 [INFO    ] DP 1: 13 lwa26
2013-06-29 03:11:20 [INFO    ] DP 1: 14 lwa14
2013-06-29 03:11:20 [INFO    ] DP 1: 16 lwa22
2013-06-29 03:11:20 [INFO    ] DP 1: 17 lwa20
2013-06-29 03:11:20 [INFO    ] DP 1: 18 lwa1
2013-06-29 03:11:20 [INFO    ] DP 1: 19 lwa5
2013-06-29 03:11:20 [INFO    ] DP 1: 20 lwa25
2013-06-29 03:11:20 [INFO    ] DP 1: 21 lwa35
2013-06-29 03:11:20 [INFO    ] DP 1: 22 lwa19
2013-06-29 03:11:20 [INFO    ] DP 1: 23 lwa21
2013-06-29 03:11:20 [INFO    ] DP 1: 24 lwa6
2013-06-29 03:11:20 [INFO    ] DP 1: 25 lwa7
2013-06-29 03:11:20 [INFO    ] DP 1: 26 lwa33
2013-06-29 03:11:20 [INFO    ] DP 1: 27 lwa15
2013-06-29 03:11:20 [INFO    ] DP 1: 28 lwa28
2013-06-29 03:11:20 [INFO    ] DP 2: 1 lwa16
2013-06-29 03:11:20 [INFO    ] DP 2: 15 lwa34
2013-06-29 03:11:20 [INFO    ] Total of 28 boards
2013-06-29 03:11:20 [INFO    ] Total of 260 stands
2013-06-29 03:11:20 [INFO    ] -------------------
2013-06-29 03:11:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2013-06-29 03:11:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2013-06-29 03:11:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2013-06-29 03:11:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2013-06-29 03:11:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2013-06-29 03:11:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2013-06-29 03:11:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2013-06-29 03:11:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2013-06-29 03:11:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2013-06-29 03:11:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2013-06-29 03:11:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2013-06-29 03:11:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2013-06-29 03:11:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2013-06-29 03:11:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2013-06-29 03:11:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2013-06-29 03:11:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2013-06-29 03:11:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2013-06-29 03:11:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2013-06-29 03:11:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2013-06-29 03:11:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2013-06-29 03:11:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2013-06-29 03:11:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2013-06-29 03:11:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2013-06-29 03:11:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2013-06-29 03:11:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2013-06-29 03:11:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2013-06-29 03:11:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2013-06-29 03:11:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2013-06-29 03:11:26 [DEBUG   ] 2013-06-29 03:11:26 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20687
2013-06-29 03:11:26 [DEBUG   ] 2013-06-29 03:11:26 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20688
2013-06-29 03:11:26 [DEBUG   ] 2013-06-29 03:11:26 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20689
2013-06-29 03:11:26 [DEBUG   ] 2013-06-29 03:11:26 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20690
2013-06-29 03:11:26 [DEBUG   ] 2013-06-29 03:11:26 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20691
2013-06-29 03:11:26 [DEBUG   ] 2013-06-29 03:11:26 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20692
2013-06-29 03:11:26 [DEBUG   ] 2013-06-29 03:11:26 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20693
2013-06-29 03:11:26 [DEBUG   ] 2013-06-29 03:11:26 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20694
2013-06-29 03:11:26 [DEBUG   ] 2013-06-29 03:11:26 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20695
2013-06-29 03:11:26 [DEBUG   ] 2013-06-29 03:11:26 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20696
2013-06-29 03:11:26 [DEBUG   ] 2013-06-29 03:11:26 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20697
2013-06-29 03:11:26 [DEBUG   ] 2013-06-29 03:11:26 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20698
2013-06-29 03:11:26 [DEBUG   ] 2013-06-29 03:11:26 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20699
2013-06-29 03:11:26 [DEBUG   ] 2013-06-29 03:11:26 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20700
2013-06-29 03:11:26 [DEBUG   ] 2013-06-29 03:11:26 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20701
2013-06-29 03:11:26 [DEBUG   ] 2013-06-29 03:11:26 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20702
2013-06-29 03:11:26 [DEBUG   ] 2013-06-29 03:11:26 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20703
2013-06-29 03:11:26 [DEBUG   ] 2013-06-29 03:11:26 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20704
2013-06-29 03:11:27 [DEBUG   ] 2013-06-29 03:11:27 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20705
2013-06-29 03:11:27 [DEBUG   ] 2013-06-29 03:11:27 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20706
2013-06-29 03:11:27 [DEBUG   ] 2013-06-29 03:11:27 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20707
2013-06-29 03:11:27 [DEBUG   ] 2013-06-29 03:11:27 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20708
2013-06-29 03:11:27 [DEBUG   ] 2013-06-29 03:11:27 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20709
2013-06-29 03:11:27 [DEBUG   ] 2013-06-29 03:11:27 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20710
2013-06-29 03:11:27 [DEBUG   ] 2013-06-29 03:11:27 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20711
2013-06-29 03:11:27 [DEBUG   ] 2013-06-29 03:11:27 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20712
2013-06-29 03:11:39 [DEBUG   ] 2013-06-29 03:11:39 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20687 exited with status 0
2013-06-29 03:11:39 [DEBUG   ] 2013-06-29 03:11:39 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20688 exited with status 0
2013-06-29 03:11:39 [DEBUG   ] 2013-06-29 03:11:39 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20689 exited with status 0
2013-06-29 03:11:39 [DEBUG   ] 2013-06-29 03:11:39 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20690 exited with status 0
2013-06-29 03:11:39 [DEBUG   ] 2013-06-29 03:11:39 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20691 exited with status 0
2013-06-29 03:11:39 [DEBUG   ] 2013-06-29 03:11:39 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20692 exited with status 0
2013-06-29 03:11:39 [DEBUG   ] 2013-06-29 03:11:39 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20693 exited with status 0
2013-06-29 03:11:39 [DEBUG   ] 2013-06-29 03:11:39 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20694 exited with status 0
2013-06-29 03:11:39 [DEBUG   ] 2013-06-29 03:11:39 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20695 exited with status 0
2013-06-29 03:11:39 [DEBUG   ] 2013-06-29 03:11:39 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20696 exited with status 0
2013-06-29 03:11:39 [DEBUG   ] 2013-06-29 03:11:39 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20697 exited with status 0
2013-06-29 03:11:39 [DEBUG   ] 2013-06-29 03:11:39 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20698 exited with status 0
2013-06-29 03:11:39 [DEBUG   ] 2013-06-29 03:11:39 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20699 exited with status 0
2013-06-29 03:11:39 [DEBUG   ] 2013-06-29 03:11:39 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20700 exited with status 0
2013-06-29 03:11:39 [DEBUG   ] 2013-06-29 03:11:39 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20701 exited with status 0
2013-06-29 03:11:39 [DEBUG   ] 2013-06-29 03:11:39 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20702 exited with status 0
2013-06-29 03:11:39 [DEBUG   ] 2013-06-29 03:11:39 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20703 exited with status 0
2013-06-29 03:11:39 [DEBUG   ] 2013-06-29 03:11:39 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20704 exited with status 0
2013-06-29 03:11:39 [DEBUG   ] 2013-06-29 03:11:39 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20705 exited with status 0
2013-06-29 03:11:39 [DEBUG   ] 2013-06-29 03:11:39 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20706 exited with status 0
2013-06-29 03:11:39 [DEBUG   ] 2013-06-29 03:11:39 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20707 exited with status 0
2013-06-29 03:11:39 [DEBUG   ] 2013-06-29 03:11:39 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20708 exited with status 0
2013-06-29 03:11:39 [DEBUG   ] 2013-06-29 03:11:39 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20709 exited with status 0
2013-06-29 03:11:39 [DEBUG   ] 2013-06-29 03:11:39 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20710 exited with status 0
2013-06-29 03:11:39 [DEBUG   ] 2013-06-29 03:11:39 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20711 exited with status 0
2013-06-29 03:11:39 [DEBUG   ] 2013-06-29 03:11:39 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20712 exited with status 0
2013-06-29 03:11:39 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2013-06-29 03:11:39 [DEBUG   ] spawn_process: at 2013-06-29 03:11:39 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2013-06-29 03:11:39 [DEBUG   ] spawn_process: at 2013-06-29 03:11:39 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2013-06-29 03:11:39 [DEBUG   ] spawn_process: at 2013-06-29 03:11:39 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2013-06-29 03:11:39 [DEBUG   ] spawn_process: at 2013-06-29 03:11:39 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2013-06-29 03:11:39 [DEBUG   ] spawn_process: at 2013-06-29 03:11:39 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2013-06-29 03:11:39 [DEBUG   ] spawn_process: at 2013-06-29 03:11:39 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2013-06-29 03:11:39 [DEBUG   ] spawn_process: at 2013-06-29 03:11:39 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2013-06-29 03:11:39 [DEBUG   ] spawn_process: at 2013-06-29 03:11:39 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2013-06-29 03:11:39 [DEBUG   ] spawn_process: at 2013-06-29 03:11:39 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2013-06-29 03:11:39 [DEBUG   ] spawn_process: at 2013-06-29 03:11:39 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2013-06-29 03:11:39 [DEBUG   ] spawn_process: at 2013-06-29 03:11:39 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2013-06-29 03:11:39 [DEBUG   ] spawn_process: at 2013-06-29 03:11:39 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2013-06-29 03:11:39 [DEBUG   ] spawn_process: at 2013-06-29 03:11:39 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2013-06-29 03:11:39 [DEBUG   ] spawn_process: at 2013-06-29 03:11:39 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2013-06-29 03:11:39 [DEBUG   ] spawn_process: at 2013-06-29 03:11:39 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2013-06-29 03:11:39 [DEBUG   ] spawn_process: at 2013-06-29 03:11:39 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2013-06-29 03:11:39 [DEBUG   ] spawn_process: at 2013-06-29 03:11:39 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2013-06-29 03:11:39 [DEBUG   ] spawn_process: at 2013-06-29 03:11:39 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2013-06-29 03:11:39 [DEBUG   ] spawn_process: at 2013-06-29 03:11:39 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2013-06-29 03:11:39 [DEBUG   ] spawn_process: at 2013-06-29 03:11:39 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2013-06-29 03:11:39 [DEBUG   ] spawn_process: at 2013-06-29 03:11:39 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2013-06-29 03:11:39 [DEBUG   ] spawn_process: at 2013-06-29 03:11:39 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2013-06-29 03:11:39 [DEBUG   ] spawn_process: at 2013-06-29 03:11:39 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2013-06-29 03:11:39 [DEBUG   ] spawn_process: at 2013-06-29 03:11:39 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2013-06-29 03:11:39 [DEBUG   ] spawn_process: at 2013-06-29 03:11:39 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2013-06-29 03:11:39 [DEBUG   ] spawn_process: at 2013-06-29 03:11:39 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2013-06-29 03:11:39 [DEBUG   ] 2013-06-29 03:11:39 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 20739
2013-06-29 03:11:39 [DEBUG   ] 2013-06-29 03:11:39 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 20740
2013-06-29 03:11:45 [DEBUG   ] 2013-06-29 03:11:45 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 20739 exited with status 0
2013-06-29 03:11:45 [DEBUG   ] 2013-06-29 03:11:45 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 20740 exited with status 0
2013-06-29 03:11:45 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2013-06-29 03:11:45 [DEBUG   ] spawn_process: at 2013-06-29 03:11:45 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2013-06-29 03:11:45 [DEBUG   ] spawn_process: at 2013-06-29 03:11:45 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2013-06-29 03:11:45 [INFO    ] Setting Beam 1 xbars
2013-06-29 03:11:45 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2013-06-29 03:11:45 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2013-06-29 03:11:45 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2013-06-29 03:11:45 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2013-06-29 03:11:45 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2013-06-29 03:11:46 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2013-06-29 03:11:46 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2013-06-29 03:11:46 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2013-06-29 03:11:46 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2013-06-29 03:11:46 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2013-06-29 03:11:46 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2013-06-29 03:11:46 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2013-06-29 03:11:46 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2013-06-29 03:11:46 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2013-06-29 03:11:46 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2013-06-29 03:11:47 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2013-06-29 03:11:47 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2013-06-29 03:11:47 [DEBUG   ] Got command RPT from MCS: ref #50469
2013-06-29 03:11:47 [DEBUG   ] summary = BOOTING
2013-06-29 03:11:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50469  15 56472 11507258 ABOOTINGBOOTING'
2013-06-29 03:11:47 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2013-06-29 03:11:47 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2013-06-29 03:11:47 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2013-06-29 03:11:47 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2013-06-29 03:11:47 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2013-06-29 03:11:47 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2013-06-29 03:11:47 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2013-06-29 03:11:48 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2013-06-29 03:11:48 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2013-06-29 03:11:48 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2013-06-29 03:11:48 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2013-06-29 03:11:48 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2013-06-29 03:11:48 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2013-06-29 03:11:48 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2013-06-29 03:11:48 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2013-06-29 03:11:48 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2013-06-29 03:11:49 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2013-06-29 03:11:49 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2013-06-29 03:11:49 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2013-06-29 03:11:49 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2013-06-29 03:11:49 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2013-06-29 03:11:49 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2013-06-29 03:11:49 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2013-06-29 03:11:49 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2013-06-29 03:11:49 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2013-06-29 03:11:50 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2013-06-29 03:11:50 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2013-06-29 03:11:50 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2013-06-29 03:11:50 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2013-06-29 03:11:50 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2013-06-29 03:11:50 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2013-06-29 03:11:50 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2013-06-29 03:11:50 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2013-06-29 03:11:50 [INFO    ] Setting Beam 2 xbars
2013-06-29 03:11:50 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2013-06-29 03:11:51 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2013-06-29 03:11:51 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2013-06-29 03:11:51 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2013-06-29 03:11:51 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2013-06-29 03:11:51 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2013-06-29 03:11:51 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2013-06-29 03:11:51 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2013-06-29 03:11:51 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2013-06-29 03:11:51 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2013-06-29 03:11:51 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2013-06-29 03:11:52 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2013-06-29 03:11:52 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2013-06-29 03:11:52 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2013-06-29 03:11:52 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2013-06-29 03:11:52 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2013-06-29 03:11:52 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2013-06-29 03:11:52 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2013-06-29 03:11:52 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2013-06-29 03:11:52 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2013-06-29 03:11:53 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2013-06-29 03:11:53 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2013-06-29 03:11:53 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2013-06-29 03:11:53 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2013-06-29 03:11:53 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2013-06-29 03:11:53 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2013-06-29 03:11:53 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2013-06-29 03:11:53 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2013-06-29 03:11:53 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2013-06-29 03:11:54 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2013-06-29 03:11:54 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2013-06-29 03:11:54 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2013-06-29 03:11:54 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2013-06-29 03:11:54 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2013-06-29 03:11:54 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2013-06-29 03:11:54 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2013-06-29 03:11:54 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2013-06-29 03:11:54 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2013-06-29 03:11:55 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2013-06-29 03:11:55 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2013-06-29 03:11:55 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2013-06-29 03:11:55 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2013-06-29 03:11:55 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2013-06-29 03:11:55 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2013-06-29 03:11:55 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2013-06-29 03:11:55 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2013-06-29 03:11:55 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2013-06-29 03:11:55 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2013-06-29 03:11:56 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2013-06-29 03:11:56 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2013-06-29 03:11:56 [INFO    ] Setting Beam 3 xbars
2013-06-29 03:11:56 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2013-06-29 03:11:56 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2013-06-29 03:11:56 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2013-06-29 03:11:56 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2013-06-29 03:11:56 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2013-06-29 03:11:56 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2013-06-29 03:11:56 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2013-06-29 03:11:57 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2013-06-29 03:11:57 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2013-06-29 03:11:57 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2013-06-29 03:11:57 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2013-06-29 03:11:57 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2013-06-29 03:11:57 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2013-06-29 03:11:57 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2013-06-29 03:11:57 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2013-06-29 03:11:57 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2013-06-29 03:11:58 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2013-06-29 03:11:58 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2013-06-29 03:11:58 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2013-06-29 03:11:58 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2013-06-29 03:11:58 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2013-06-29 03:11:58 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2013-06-29 03:11:58 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2013-06-29 03:11:58 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2013-06-29 03:11:58 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2013-06-29 03:11:59 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2013-06-29 03:11:59 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2013-06-29 03:11:59 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2013-06-29 03:11:59 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2013-06-29 03:11:59 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2013-06-29 03:11:59 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2013-06-29 03:11:59 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2013-06-29 03:11:59 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2013-06-29 03:11:59 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2013-06-29 03:11:59 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2013-06-29 03:12:00 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2013-06-29 03:12:00 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2013-06-29 03:12:00 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2013-06-29 03:12:00 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2013-06-29 03:12:00 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2013-06-29 03:12:00 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2013-06-29 03:12:00 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2013-06-29 03:12:00 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2013-06-29 03:12:00 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2013-06-29 03:12:01 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2013-06-29 03:12:01 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2013-06-29 03:12:01 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2013-06-29 03:12:01 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2013-06-29 03:12:01 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2013-06-29 03:12:01 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2013-06-29 03:12:01 [INFO    ] Setting Beam 4 xbars
2013-06-29 03:12:01 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2013-06-29 03:12:01 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2013-06-29 03:12:01 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2013-06-29 03:12:02 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2013-06-29 03:12:02 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2013-06-29 03:12:02 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2013-06-29 03:12:02 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2013-06-29 03:12:02 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2013-06-29 03:12:02 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2013-06-29 03:12:02 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2013-06-29 03:12:02 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2013-06-29 03:12:02 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2013-06-29 03:12:03 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2013-06-29 03:12:03 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2013-06-29 03:12:03 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2013-06-29 03:12:03 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2013-06-29 03:12:03 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2013-06-29 03:12:03 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2013-06-29 03:12:03 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2013-06-29 03:12:03 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2013-06-29 03:12:03 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2013-06-29 03:12:04 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2013-06-29 03:12:04 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2013-06-29 03:12:04 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2013-06-29 03:12:04 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2013-06-29 03:12:04 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2013-06-29 03:12:04 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2013-06-29 03:12:04 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2013-06-29 03:12:04 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2013-06-29 03:12:04 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2013-06-29 03:12:05 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2013-06-29 03:12:05 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2013-06-29 03:12:05 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2013-06-29 03:12:05 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2013-06-29 03:12:05 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2013-06-29 03:12:05 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2013-06-29 03:12:05 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2013-06-29 03:12:05 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2013-06-29 03:12:05 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2013-06-29 03:12:06 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2013-06-29 03:12:06 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2013-06-29 03:12:06 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2013-06-29 03:12:06 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2013-06-29 03:12:06 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2013-06-29 03:12:06 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2013-06-29 03:12:06 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2013-06-29 03:12:06 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2013-06-29 03:12:06 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2013-06-29 03:12:06 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2013-06-29 03:12:07 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2013-06-29 03:12:07 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2013-06-29 03:12:07 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2013-06-29 03:12:07 [INFO    ] All xbars set
2013-06-29 03:12:07 [INFO    ] Setting adder chain routing for all beams
2013-06-29 03:12:12 [INFO    ] Setting beam ids
2013-06-29 03:12:22 [INFO    ] Starting beam delay calibration
2013-06-29 03:12:34 [INFO    ] Beam 1 latency is 6593
2013-06-29 03:12:34 [INFO    ] Beam 2 latency is 7606
2013-06-29 03:12:34 [INFO    ] Beam 3 latency is 390
2013-06-29 03:12:34 [INFO    ] Beam 4 latency is 6610
2013-06-29 03:12:34 [INFO    ] Stop calibration
2013-06-29 03:12:42 [ERROR   ] Beam delay calibration failed
2013-06-29 03:12:42 [CRITICAL] Calibration failed
2013-06-29 03:12:42 [DEBUG   ] spawn_process: at 2013-06-29 03:12:42 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2013-06-29 03:12:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2013-06-29 03:12:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2013-06-29 03:12:42 [DEBUG   ] spawn_process: at 2013-06-29 03:12:42 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2013-06-29 03:12:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2013-06-29 03:12:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2013-06-29 03:12:42 [DEBUG   ] spawn_process: at 2013-06-29 03:12:42 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2013-06-29 03:12:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2013-06-29 03:12:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2013-06-29 03:12:42 [DEBUG   ] spawn_process: at 2013-06-29 03:12:42 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2013-06-29 03:12:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2013-06-29 03:12:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2013-06-29 03:12:42 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2013-06-29 03:12:43 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 74 ms (1372475563.074 s) with PID 22324 and time 1372475562
2013-06-29 03:12:43 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2013-06-29 03:12:43 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 164 ms (1372475563.164 s) with PID 22327 and time 1372475562
2013-06-29 03:12:44 [INFO    ] Started antennas statistics background thread
2013-06-29 03:12:44 [INFO    ] Started board flags background thread
2013-06-29 03:12:44 [INFO    ] Started BAM background thread
2013-06-29 03:12:44 [INFO    ] Finished the INI process (ref. #50467) in 103.526 s
2013-06-29 03:12:44 [DEBUG   ] Finished updating ant stats in 1.123 seconds
2013-06-29 03:12:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 03:12:45 [DEBUG   ] Finished updating board flags in 1.273 seconds
2013-06-29 03:13:04 [DEBUG   ] Finished updating ant stats in 0.960 seconds
2013-06-29 03:13:24 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 03:13:39 [DEBUG   ] Got command RPT from MCS: ref #50473
2013-06-29 03:13:39 [DEBUG   ] summary = ERROR
2013-06-29 03:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50473  13 56472 11619469 A  ERRORERROR'
2013-06-29 03:13:39 [DEBUG   ] Got command RPT from MCS: ref #50474
2013-06-29 03:13:39 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x06! Beamformer calibration failed
2013-06-29 03:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50474  72 56472 11619470 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x06! Beamformer calibration failed'
2013-06-29 03:13:44 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 03:13:45 [DEBUG   ] Finished updating board flags in 1.200 seconds
2013-06-29 03:14:04 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 03:14:24 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-06-29 03:14:44 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-06-29 03:14:46 [DEBUG   ] Finished updating board flags in 1.998 seconds
2013-06-29 03:15:04 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-06-29 03:15:16 [DEBUG   ] Got command RPT from MCS: ref #50490
2013-06-29 03:15:16 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x06! Beamformer calibration failed
2013-06-29 03:15:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50490  72 56472 11716253 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x06! Beamformer calibration failed'
2013-06-29 03:15:24 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-06-29 03:15:26 [DEBUG   ] Got command INI from MCS: ref #50491
2013-06-29 03:15:26 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2013-06-29 03:15:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    50491   8 56472 11726690 ABOOTING'
2013-06-29 03:15:47 [INFO    ] -------------------
2013-06-29 03:15:47 [INFO    ]  LWA board status
2013-06-29 03:15:47 [INFO    ] -------------------
2013-06-29 03:15:47 [INFO    ] DP 1: 2 lwa27
2013-06-29 03:15:47 [INFO    ] DP 1: 3 lwa24
2013-06-29 03:15:47 [INFO    ] DP 1: 4 lwa23
2013-06-29 03:15:47 [INFO    ] DP 1: 5 lwa18
2013-06-29 03:15:47 [INFO    ] DP 1: 6 lwa10
2013-06-29 03:15:47 [INFO    ] DP 1: 7 lwa32
2013-06-29 03:15:47 [INFO    ] DP 1: 8 lwa11
2013-06-29 03:15:47 [INFO    ] DP 1: 9 lwa30
2013-06-29 03:15:47 [INFO    ] DP 1: 10 lwa12
2013-06-29 03:15:47 [INFO    ] DP 1: 11 lwa8
2013-06-29 03:15:47 [INFO    ] DP 1: 12 lwa13
2013-06-29 03:15:47 [INFO    ] DP 1: 13 lwa26
2013-06-29 03:15:47 [INFO    ] DP 1: 14 lwa14
2013-06-29 03:15:47 [INFO    ] DP 1: 16 lwa22
2013-06-29 03:15:47 [INFO    ] DP 1: 17 lwa20
2013-06-29 03:15:47 [INFO    ] DP 1: 18 lwa1
2013-06-29 03:15:47 [INFO    ] DP 1: 19 lwa5
2013-06-29 03:15:47 [INFO    ] DP 1: 20 lwa25
2013-06-29 03:15:47 [INFO    ] DP 1: 21 lwa35
2013-06-29 03:15:47 [INFO    ] DP 1: 22 lwa19
2013-06-29 03:15:47 [INFO    ] DP 1: 23 lwa21
2013-06-29 03:15:47 [INFO    ] DP 1: 24 lwa6
2013-06-29 03:15:47 [INFO    ] DP 1: 25 lwa7
2013-06-29 03:15:47 [INFO    ] DP 1: 26 lwa33
2013-06-29 03:15:47 [INFO    ] DP 1: 27 lwa15
2013-06-29 03:15:47 [INFO    ] DP 1: 28 lwa28
2013-06-29 03:15:47 [INFO    ] DP 2: 1 lwa16
2013-06-29 03:15:47 [INFO    ] DP 2: 15 lwa34
2013-06-29 03:15:47 [INFO    ] Total of 28 boards
2013-06-29 03:15:47 [INFO    ] Total of 260 stands
2013-06-29 03:15:47 [INFO    ] -------------------
2013-06-29 03:15:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2013-06-29 03:15:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2013-06-29 03:15:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2013-06-29 03:15:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2013-06-29 03:15:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2013-06-29 03:15:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2013-06-29 03:15:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2013-06-29 03:15:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2013-06-29 03:15:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2013-06-29 03:15:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2013-06-29 03:15:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2013-06-29 03:15:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2013-06-29 03:15:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2013-06-29 03:15:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2013-06-29 03:15:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2013-06-29 03:15:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2013-06-29 03:15:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2013-06-29 03:15:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2013-06-29 03:15:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2013-06-29 03:15:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2013-06-29 03:15:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2013-06-29 03:15:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2013-06-29 03:15:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2013-06-29 03:15:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2013-06-29 03:15:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2013-06-29 03:15:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2013-06-29 03:15:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2013-06-29 03:15:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2013-06-29 03:15:54 [DEBUG   ] 2013-06-29 03:15:54 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23015
2013-06-29 03:15:54 [DEBUG   ] 2013-06-29 03:15:54 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23016
2013-06-29 03:15:54 [DEBUG   ] 2013-06-29 03:15:54 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23017
2013-06-29 03:15:54 [DEBUG   ] 2013-06-29 03:15:54 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23018
2013-06-29 03:15:54 [DEBUG   ] 2013-06-29 03:15:54 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23019
2013-06-29 03:15:54 [DEBUG   ] 2013-06-29 03:15:54 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23020
2013-06-29 03:15:54 [DEBUG   ] 2013-06-29 03:15:54 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23021
2013-06-29 03:15:54 [DEBUG   ] 2013-06-29 03:15:54 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23022
2013-06-29 03:15:54 [DEBUG   ] 2013-06-29 03:15:54 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23023
2013-06-29 03:15:54 [DEBUG   ] 2013-06-29 03:15:54 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23024
2013-06-29 03:15:54 [DEBUG   ] 2013-06-29 03:15:54 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23025
2013-06-29 03:15:54 [DEBUG   ] 2013-06-29 03:15:54 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23026
2013-06-29 03:15:54 [DEBUG   ] 2013-06-29 03:15:54 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23027
2013-06-29 03:15:54 [DEBUG   ] 2013-06-29 03:15:54 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23028
2013-06-29 03:15:54 [DEBUG   ] 2013-06-29 03:15:54 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23029
2013-06-29 03:15:54 [DEBUG   ] 2013-06-29 03:15:54 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23030
2013-06-29 03:15:54 [DEBUG   ] 2013-06-29 03:15:54 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23031
2013-06-29 03:15:54 [DEBUG   ] 2013-06-29 03:15:54 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23032
2013-06-29 03:15:54 [DEBUG   ] 2013-06-29 03:15:54 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23033
2013-06-29 03:15:54 [DEBUG   ] 2013-06-29 03:15:54 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23034
2013-06-29 03:15:54 [DEBUG   ] 2013-06-29 03:15:54 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23035
2013-06-29 03:15:54 [DEBUG   ] 2013-06-29 03:15:54 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23036
2013-06-29 03:15:54 [DEBUG   ] 2013-06-29 03:15:54 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23037
2013-06-29 03:15:54 [DEBUG   ] 2013-06-29 03:15:54 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23038
2013-06-29 03:15:54 [DEBUG   ] 2013-06-29 03:15:54 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23039
2013-06-29 03:15:54 [DEBUG   ] 2013-06-29 03:15:54 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23040
2013-06-29 03:16:06 [DEBUG   ] 2013-06-29 03:16:06 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23015 exited with status 0
2013-06-29 03:16:06 [DEBUG   ] 2013-06-29 03:16:06 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23016 exited with status 0
2013-06-29 03:16:06 [DEBUG   ] 2013-06-29 03:16:06 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23017 exited with status 0
2013-06-29 03:16:06 [DEBUG   ] 2013-06-29 03:16:06 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23018 exited with status 0
2013-06-29 03:16:06 [DEBUG   ] 2013-06-29 03:16:06 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23019 exited with status 0
2013-06-29 03:16:06 [DEBUG   ] 2013-06-29 03:16:06 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23020 exited with status 0
2013-06-29 03:16:06 [DEBUG   ] 2013-06-29 03:16:06 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23021 exited with status 0
2013-06-29 03:16:06 [DEBUG   ] 2013-06-29 03:16:06 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23022 exited with status 0
2013-06-29 03:16:06 [DEBUG   ] 2013-06-29 03:16:06 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23023 exited with status 0
2013-06-29 03:16:06 [DEBUG   ] 2013-06-29 03:16:06 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23024 exited with status 0
2013-06-29 03:16:06 [DEBUG   ] 2013-06-29 03:16:06 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23025 exited with status 0
2013-06-29 03:16:06 [DEBUG   ] 2013-06-29 03:16:06 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23026 exited with status 0
2013-06-29 03:16:06 [DEBUG   ] 2013-06-29 03:16:06 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23027 exited with status 0
2013-06-29 03:16:06 [DEBUG   ] 2013-06-29 03:16:06 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23028 exited with status 0
2013-06-29 03:16:06 [DEBUG   ] 2013-06-29 03:16:06 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23029 exited with status 0
2013-06-29 03:16:06 [DEBUG   ] 2013-06-29 03:16:06 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23030 exited with status 0
2013-06-29 03:16:06 [DEBUG   ] 2013-06-29 03:16:06 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23031 exited with status 0
2013-06-29 03:16:06 [DEBUG   ] 2013-06-29 03:16:06 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23032 exited with status 0
2013-06-29 03:16:06 [DEBUG   ] 2013-06-29 03:16:06 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23033 exited with status 0
2013-06-29 03:16:06 [DEBUG   ] 2013-06-29 03:16:06 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23034 exited with status 0
2013-06-29 03:16:06 [DEBUG   ] 2013-06-29 03:16:06 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23035 exited with status 0
2013-06-29 03:16:06 [DEBUG   ] 2013-06-29 03:16:06 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23036 exited with status 0
2013-06-29 03:16:06 [DEBUG   ] 2013-06-29 03:16:06 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23037 exited with status 0
2013-06-29 03:16:06 [DEBUG   ] 2013-06-29 03:16:06 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23038 exited with status 0
2013-06-29 03:16:06 [DEBUG   ] 2013-06-29 03:16:06 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23039 exited with status 0
2013-06-29 03:16:06 [DEBUG   ] 2013-06-29 03:16:06 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23040 exited with status 0
2013-06-29 03:16:06 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2013-06-29 03:16:06 [DEBUG   ] spawn_process: at 2013-06-29 03:16:06 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2013-06-29 03:16:06 [DEBUG   ] spawn_process: at 2013-06-29 03:16:06 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2013-06-29 03:16:06 [DEBUG   ] spawn_process: at 2013-06-29 03:16:06 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2013-06-29 03:16:06 [DEBUG   ] spawn_process: at 2013-06-29 03:16:06 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2013-06-29 03:16:06 [DEBUG   ] spawn_process: at 2013-06-29 03:16:06 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2013-06-29 03:16:06 [DEBUG   ] spawn_process: at 2013-06-29 03:16:06 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2013-06-29 03:16:06 [DEBUG   ] spawn_process: at 2013-06-29 03:16:06 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2013-06-29 03:16:06 [DEBUG   ] spawn_process: at 2013-06-29 03:16:06 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2013-06-29 03:16:06 [DEBUG   ] spawn_process: at 2013-06-29 03:16:06 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2013-06-29 03:16:06 [DEBUG   ] spawn_process: at 2013-06-29 03:16:06 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2013-06-29 03:16:06 [DEBUG   ] spawn_process: at 2013-06-29 03:16:06 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2013-06-29 03:16:06 [DEBUG   ] spawn_process: at 2013-06-29 03:16:06 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2013-06-29 03:16:06 [DEBUG   ] spawn_process: at 2013-06-29 03:16:06 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2013-06-29 03:16:06 [DEBUG   ] spawn_process: at 2013-06-29 03:16:06 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2013-06-29 03:16:06 [DEBUG   ] spawn_process: at 2013-06-29 03:16:06 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2013-06-29 03:16:06 [DEBUG   ] spawn_process: at 2013-06-29 03:16:06 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2013-06-29 03:16:06 [DEBUG   ] spawn_process: at 2013-06-29 03:16:06 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2013-06-29 03:16:06 [DEBUG   ] spawn_process: at 2013-06-29 03:16:06 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2013-06-29 03:16:06 [DEBUG   ] spawn_process: at 2013-06-29 03:16:06 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2013-06-29 03:16:06 [DEBUG   ] spawn_process: at 2013-06-29 03:16:06 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2013-06-29 03:16:06 [DEBUG   ] spawn_process: at 2013-06-29 03:16:06 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2013-06-29 03:16:06 [DEBUG   ] spawn_process: at 2013-06-29 03:16:06 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2013-06-29 03:16:06 [DEBUG   ] spawn_process: at 2013-06-29 03:16:06 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2013-06-29 03:16:06 [DEBUG   ] spawn_process: at 2013-06-29 03:16:06 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2013-06-29 03:16:06 [DEBUG   ] spawn_process: at 2013-06-29 03:16:06 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2013-06-29 03:16:06 [DEBUG   ] spawn_process: at 2013-06-29 03:16:06 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2013-06-29 03:16:06 [DEBUG   ] 2013-06-29 03:16:06 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 23067
2013-06-29 03:16:06 [DEBUG   ] 2013-06-29 03:16:06 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 23068
2013-06-29 03:16:12 [DEBUG   ] 2013-06-29 03:16:12 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 23067 exited with status 0
2013-06-29 03:16:12 [DEBUG   ] 2013-06-29 03:16:12 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 23068 exited with status 0
2013-06-29 03:16:12 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2013-06-29 03:16:12 [DEBUG   ] spawn_process: at 2013-06-29 03:16:12 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2013-06-29 03:16:12 [DEBUG   ] spawn_process: at 2013-06-29 03:16:12 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2013-06-29 03:16:12 [INFO    ] Setting Beam 1 xbars
2013-06-29 03:16:12 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2013-06-29 03:16:12 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2013-06-29 03:16:12 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2013-06-29 03:16:12 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2013-06-29 03:16:12 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2013-06-29 03:16:13 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2013-06-29 03:16:13 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2013-06-29 03:16:13 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2013-06-29 03:16:13 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2013-06-29 03:16:13 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2013-06-29 03:16:13 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2013-06-29 03:16:13 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2013-06-29 03:16:13 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2013-06-29 03:16:13 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2013-06-29 03:16:14 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2013-06-29 03:16:14 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2013-06-29 03:16:14 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2013-06-29 03:16:14 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2013-06-29 03:16:14 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2013-06-29 03:16:14 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2013-06-29 03:16:14 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2013-06-29 03:16:14 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2013-06-29 03:16:14 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2013-06-29 03:16:15 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2013-06-29 03:16:15 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2013-06-29 03:16:15 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2013-06-29 03:16:15 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2013-06-29 03:16:15 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2013-06-29 03:16:15 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2013-06-29 03:16:15 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2013-06-29 03:16:15 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2013-06-29 03:16:15 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2013-06-29 03:16:15 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2013-06-29 03:16:16 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2013-06-29 03:16:16 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2013-06-29 03:16:16 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2013-06-29 03:16:16 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2013-06-29 03:16:16 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2013-06-29 03:16:16 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2013-06-29 03:16:16 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2013-06-29 03:16:16 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2013-06-29 03:16:16 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2013-06-29 03:16:17 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2013-06-29 03:16:17 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2013-06-29 03:16:17 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2013-06-29 03:16:17 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2013-06-29 03:16:17 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2013-06-29 03:16:17 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2013-06-29 03:16:17 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2013-06-29 03:16:17 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2013-06-29 03:16:17 [INFO    ] Setting Beam 2 xbars
2013-06-29 03:16:17 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2013-06-29 03:16:18 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2013-06-29 03:16:18 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2013-06-29 03:16:18 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2013-06-29 03:16:18 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2013-06-29 03:16:18 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2013-06-29 03:16:18 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2013-06-29 03:16:18 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2013-06-29 03:16:18 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2013-06-29 03:16:18 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2013-06-29 03:16:18 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2013-06-29 03:16:19 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2013-06-29 03:16:19 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2013-06-29 03:16:19 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2013-06-29 03:16:19 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2013-06-29 03:16:19 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2013-06-29 03:16:19 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2013-06-29 03:16:19 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2013-06-29 03:16:19 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2013-06-29 03:16:19 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2013-06-29 03:16:20 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2013-06-29 03:16:20 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2013-06-29 03:16:20 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2013-06-29 03:16:20 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2013-06-29 03:16:20 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2013-06-29 03:16:20 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2013-06-29 03:16:20 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2013-06-29 03:16:20 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2013-06-29 03:16:20 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2013-06-29 03:16:21 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2013-06-29 03:16:21 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2013-06-29 03:16:21 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2013-06-29 03:16:21 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2013-06-29 03:16:21 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2013-06-29 03:16:21 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2013-06-29 03:16:21 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2013-06-29 03:16:21 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2013-06-29 03:16:21 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2013-06-29 03:16:22 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2013-06-29 03:16:22 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2013-06-29 03:16:22 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2013-06-29 03:16:22 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2013-06-29 03:16:22 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2013-06-29 03:16:22 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2013-06-29 03:16:22 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2013-06-29 03:16:22 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2013-06-29 03:16:22 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2013-06-29 03:16:22 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2013-06-29 03:16:23 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2013-06-29 03:16:23 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2013-06-29 03:16:23 [INFO    ] Setting Beam 3 xbars
2013-06-29 03:16:23 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2013-06-29 03:16:23 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2013-06-29 03:16:23 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2013-06-29 03:16:23 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2013-06-29 03:16:23 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2013-06-29 03:16:23 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2013-06-29 03:16:23 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2013-06-29 03:16:24 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2013-06-29 03:16:24 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2013-06-29 03:16:24 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2013-06-29 03:16:24 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2013-06-29 03:16:24 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2013-06-29 03:16:24 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2013-06-29 03:16:24 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2013-06-29 03:16:24 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2013-06-29 03:16:24 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2013-06-29 03:16:25 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2013-06-29 03:16:25 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2013-06-29 03:16:25 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2013-06-29 03:16:25 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2013-06-29 03:16:25 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2013-06-29 03:16:25 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2013-06-29 03:16:25 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2013-06-29 03:16:25 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2013-06-29 03:16:25 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2013-06-29 03:16:26 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2013-06-29 03:16:26 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2013-06-29 03:16:26 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2013-06-29 03:16:26 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2013-06-29 03:16:26 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2013-06-29 03:16:26 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2013-06-29 03:16:26 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2013-06-29 03:16:26 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2013-06-29 03:16:26 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2013-06-29 03:16:26 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2013-06-29 03:16:27 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2013-06-29 03:16:27 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2013-06-29 03:16:27 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2013-06-29 03:16:27 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2013-06-29 03:16:27 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2013-06-29 03:16:27 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2013-06-29 03:16:27 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2013-06-29 03:16:27 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2013-06-29 03:16:27 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2013-06-29 03:16:28 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2013-06-29 03:16:28 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2013-06-29 03:16:28 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2013-06-29 03:16:28 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2013-06-29 03:16:28 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2013-06-29 03:16:28 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2013-06-29 03:16:28 [INFO    ] Setting Beam 4 xbars
2013-06-29 03:16:28 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2013-06-29 03:16:28 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2013-06-29 03:16:28 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2013-06-29 03:16:29 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2013-06-29 03:16:29 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2013-06-29 03:16:29 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2013-06-29 03:16:29 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2013-06-29 03:16:29 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2013-06-29 03:16:29 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2013-06-29 03:16:29 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2013-06-29 03:16:29 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2013-06-29 03:16:29 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2013-06-29 03:16:30 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2013-06-29 03:16:30 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2013-06-29 03:16:30 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2013-06-29 03:16:30 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2013-06-29 03:16:30 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2013-06-29 03:16:30 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2013-06-29 03:16:30 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2013-06-29 03:16:30 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2013-06-29 03:16:30 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2013-06-29 03:16:31 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2013-06-29 03:16:31 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2013-06-29 03:16:31 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2013-06-29 03:16:31 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2013-06-29 03:16:31 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2013-06-29 03:16:31 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2013-06-29 03:16:31 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2013-06-29 03:16:31 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2013-06-29 03:16:31 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2013-06-29 03:16:31 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2013-06-29 03:16:32 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2013-06-29 03:16:32 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2013-06-29 03:16:32 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2013-06-29 03:16:32 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2013-06-29 03:16:32 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2013-06-29 03:16:32 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2013-06-29 03:16:32 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2013-06-29 03:16:32 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2013-06-29 03:16:32 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2013-06-29 03:16:33 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2013-06-29 03:16:33 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2013-06-29 03:16:33 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2013-06-29 03:16:33 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2013-06-29 03:16:33 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2013-06-29 03:16:33 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2013-06-29 03:16:33 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2013-06-29 03:16:33 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2013-06-29 03:16:33 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2013-06-29 03:16:34 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2013-06-29 03:16:34 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2013-06-29 03:16:34 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2013-06-29 03:16:34 [INFO    ] All xbars set
2013-06-29 03:16:34 [INFO    ] Setting adder chain routing for all beams
2013-06-29 03:16:39 [INFO    ] Setting beam ids
2013-06-29 03:16:48 [DEBUG   ] Got command RPT from MCS: ref #50494
2013-06-29 03:16:48 [DEBUG   ] summary = BOOTING
2013-06-29 03:16:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50494  15 56472 11808373 ABOOTINGBOOTING'
2013-06-29 03:16:49 [INFO    ] Starting beam delay calibration
2013-06-29 03:17:00 [DEBUG   ] Got command RPT from MCS: ref #50495
2013-06-29 03:17:00 [DEBUG   ] summary = BOOTING
2013-06-29 03:17:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50495  15 56472 11820290 ABOOTINGBOOTING'
2013-06-29 03:17:01 [INFO    ] Beam 1 latency is 5737
2013-06-29 03:17:01 [INFO    ] Beam 2 latency is 5770
2013-06-29 03:17:01 [INFO    ] Beam 3 latency is 6714
2013-06-29 03:17:01 [INFO    ] Beam 4 latency is 5751
2013-06-29 03:17:01 [INFO    ] Stop calibration
2013-06-29 03:17:09 [ERROR   ] Beam delay calibration failed
2013-06-29 03:17:09 [CRITICAL] Calibration failed
2013-06-29 03:17:09 [DEBUG   ] spawn_process: at 2013-06-29 03:17:09 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2013-06-29 03:17:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2013-06-29 03:17:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2013-06-29 03:17:09 [DEBUG   ] spawn_process: at 2013-06-29 03:17:09 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2013-06-29 03:17:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2013-06-29 03:17:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2013-06-29 03:17:09 [DEBUG   ] spawn_process: at 2013-06-29 03:17:09 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2013-06-29 03:17:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2013-06-29 03:17:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2013-06-29 03:17:09 [DEBUG   ] spawn_process: at 2013-06-29 03:17:09 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2013-06-29 03:17:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2013-06-29 03:17:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2013-06-29 03:17:09 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2013-06-29 03:17:10 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 92 ms (1372475830.092 s) with PID 24648 and time 1372475829
2013-06-29 03:17:10 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2013-06-29 03:17:10 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 182 ms (1372475830.182 s) with PID 24651 and time 1372475829
2013-06-29 03:17:11 [INFO    ] Started antennas statistics background thread
2013-06-29 03:17:11 [INFO    ] Started board flags background thread
2013-06-29 03:17:11 [INFO    ] Started BAM background thread
2013-06-29 03:17:11 [DEBUG   ] Finished updating ant stats in 1.093 seconds
2013-06-29 03:17:11 [INFO    ] Finished the INI process (ref. #50491) in 104.616 s
2013-06-29 03:17:12 [DEBUG   ] Finished updating board flags in 1.243 seconds
2013-06-29 03:17:30 [DEBUG   ] Got command RPT from MCS: ref #50496
2013-06-29 03:17:30 [DEBUG   ] summary = ERROR
2013-06-29 03:17:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50496  13 56472 11850633 A  ERRORERROR'
2013-06-29 03:17:31 [DEBUG   ] Finished updating ant stats in 0.972 seconds
2013-06-29 03:17:35 [DEBUG   ] Got command RPT from MCS: ref #50497
2013-06-29 03:17:35 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x06! Beamformer calibration failed
2013-06-29 03:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50497  72 56472 11855637 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x06! Beamformer calibration failed'
2013-06-29 03:17:42 [DEBUG   ] Got command INI from MCS: ref #50498
2013-06-29 03:17:42 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2013-06-29 03:17:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    50498   8 56472 11862278 ABOOTING'
2013-06-29 03:18:03 [INFO    ] -------------------
2013-06-29 03:18:03 [INFO    ]  LWA board status
2013-06-29 03:18:03 [INFO    ] -------------------
2013-06-29 03:18:03 [INFO    ] DP 1: 2 lwa27
2013-06-29 03:18:03 [INFO    ] DP 1: 3 lwa24
2013-06-29 03:18:03 [INFO    ] DP 1: 4 lwa23
2013-06-29 03:18:03 [INFO    ] DP 1: 5 lwa18
2013-06-29 03:18:03 [INFO    ] DP 1: 6 lwa10
2013-06-29 03:18:03 [INFO    ] DP 1: 7 lwa32
2013-06-29 03:18:03 [INFO    ] DP 1: 8 lwa11
2013-06-29 03:18:03 [INFO    ] DP 1: 9 lwa30
2013-06-29 03:18:03 [INFO    ] DP 1: 10 lwa12
2013-06-29 03:18:03 [INFO    ] DP 1: 11 lwa8
2013-06-29 03:18:03 [INFO    ] DP 1: 12 lwa13
2013-06-29 03:18:03 [INFO    ] DP 1: 13 lwa26
2013-06-29 03:18:03 [INFO    ] DP 1: 14 lwa14
2013-06-29 03:18:03 [INFO    ] DP 1: 16 lwa22
2013-06-29 03:18:03 [INFO    ] DP 1: 17 lwa20
2013-06-29 03:18:03 [INFO    ] DP 1: 18 lwa1
2013-06-29 03:18:03 [INFO    ] DP 1: 19 lwa5
2013-06-29 03:18:03 [INFO    ] DP 1: 20 lwa25
2013-06-29 03:18:03 [INFO    ] DP 1: 21 lwa35
2013-06-29 03:18:03 [INFO    ] DP 1: 22 lwa19
2013-06-29 03:18:03 [INFO    ] DP 1: 23 lwa21
2013-06-29 03:18:03 [INFO    ] DP 1: 24 lwa6
2013-06-29 03:18:03 [INFO    ] DP 1: 25 lwa7
2013-06-29 03:18:03 [INFO    ] DP 1: 26 lwa33
2013-06-29 03:18:03 [INFO    ] DP 1: 27 lwa15
2013-06-29 03:18:03 [INFO    ] DP 1: 28 lwa28
2013-06-29 03:18:03 [INFO    ] DP 2: 1 lwa16
2013-06-29 03:18:03 [INFO    ] DP 2: 15 lwa34
2013-06-29 03:18:03 [INFO    ] Total of 28 boards
2013-06-29 03:18:03 [INFO    ] Total of 260 stands
2013-06-29 03:18:03 [INFO    ] -------------------
2013-06-29 03:18:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2013-06-29 03:18:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2013-06-29 03:18:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2013-06-29 03:18:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2013-06-29 03:18:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2013-06-29 03:18:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2013-06-29 03:18:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2013-06-29 03:18:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2013-06-29 03:18:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2013-06-29 03:18:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2013-06-29 03:18:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2013-06-29 03:18:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2013-06-29 03:18:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2013-06-29 03:18:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2013-06-29 03:18:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2013-06-29 03:18:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2013-06-29 03:18:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2013-06-29 03:18:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2013-06-29 03:18:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2013-06-29 03:18:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2013-06-29 03:18:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2013-06-29 03:18:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2013-06-29 03:18:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2013-06-29 03:18:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2013-06-29 03:18:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2013-06-29 03:18:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2013-06-29 03:18:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2013-06-29 03:18:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2013-06-29 03:18:10 [DEBUG   ] 2013-06-29 03:18:10 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25096
2013-06-29 03:18:10 [DEBUG   ] 2013-06-29 03:18:10 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25097
2013-06-29 03:18:10 [DEBUG   ] 2013-06-29 03:18:10 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25098
2013-06-29 03:18:10 [DEBUG   ] 2013-06-29 03:18:10 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25099
2013-06-29 03:18:10 [DEBUG   ] 2013-06-29 03:18:10 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25100
2013-06-29 03:18:10 [DEBUG   ] 2013-06-29 03:18:10 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25101
2013-06-29 03:18:10 [DEBUG   ] 2013-06-29 03:18:10 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25102
2013-06-29 03:18:10 [DEBUG   ] 2013-06-29 03:18:10 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25103
2013-06-29 03:18:10 [DEBUG   ] 2013-06-29 03:18:10 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25104
2013-06-29 03:18:10 [DEBUG   ] 2013-06-29 03:18:10 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25105
2013-06-29 03:18:10 [DEBUG   ] 2013-06-29 03:18:10 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25106
2013-06-29 03:18:10 [DEBUG   ] 2013-06-29 03:18:10 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25107
2013-06-29 03:18:10 [DEBUG   ] 2013-06-29 03:18:10 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25108
2013-06-29 03:18:10 [DEBUG   ] 2013-06-29 03:18:10 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25109
2013-06-29 03:18:10 [DEBUG   ] 2013-06-29 03:18:10 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25110
2013-06-29 03:18:10 [DEBUG   ] 2013-06-29 03:18:10 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25111
2013-06-29 03:18:10 [DEBUG   ] 2013-06-29 03:18:10 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25112
2013-06-29 03:18:10 [DEBUG   ] 2013-06-29 03:18:10 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25113
2013-06-29 03:18:10 [DEBUG   ] 2013-06-29 03:18:10 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25114
2013-06-29 03:18:10 [DEBUG   ] 2013-06-29 03:18:10 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25115
2013-06-29 03:18:10 [DEBUG   ] 2013-06-29 03:18:10 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25116
2013-06-29 03:18:10 [DEBUG   ] 2013-06-29 03:18:10 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25117
2013-06-29 03:18:10 [DEBUG   ] 2013-06-29 03:18:10 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25118
2013-06-29 03:18:10 [DEBUG   ] 2013-06-29 03:18:10 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25119
2013-06-29 03:18:10 [DEBUG   ] 2013-06-29 03:18:10 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25120
2013-06-29 03:18:10 [DEBUG   ] 2013-06-29 03:18:10 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25121
2013-06-29 03:18:22 [DEBUG   ] 2013-06-29 03:18:22 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25096 exited with status 0
2013-06-29 03:18:22 [DEBUG   ] 2013-06-29 03:18:22 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25097 exited with status 0
2013-06-29 03:18:22 [DEBUG   ] 2013-06-29 03:18:22 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25098 exited with status 0
2013-06-29 03:18:22 [DEBUG   ] 2013-06-29 03:18:22 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25099 exited with status 0
2013-06-29 03:18:22 [DEBUG   ] 2013-06-29 03:18:22 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25100 exited with status 0
2013-06-29 03:18:22 [DEBUG   ] 2013-06-29 03:18:22 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25101 exited with status 0
2013-06-29 03:18:22 [DEBUG   ] 2013-06-29 03:18:22 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25102 exited with status 0
2013-06-29 03:18:22 [DEBUG   ] 2013-06-29 03:18:22 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25103 exited with status 0
2013-06-29 03:18:22 [DEBUG   ] 2013-06-29 03:18:22 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25104 exited with status 0
2013-06-29 03:18:22 [DEBUG   ] 2013-06-29 03:18:22 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25105 exited with status 0
2013-06-29 03:18:22 [DEBUG   ] 2013-06-29 03:18:22 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25106 exited with status 0
2013-06-29 03:18:22 [DEBUG   ] 2013-06-29 03:18:22 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25107 exited with status 0
2013-06-29 03:18:22 [DEBUG   ] 2013-06-29 03:18:22 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25108 exited with status 0
2013-06-29 03:18:22 [DEBUG   ] 2013-06-29 03:18:22 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25109 exited with status 0
2013-06-29 03:18:22 [DEBUG   ] 2013-06-29 03:18:22 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25110 exited with status 0
2013-06-29 03:18:22 [DEBUG   ] 2013-06-29 03:18:22 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25111 exited with status 0
2013-06-29 03:18:22 [DEBUG   ] 2013-06-29 03:18:22 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25112 exited with status 0
2013-06-29 03:18:22 [DEBUG   ] 2013-06-29 03:18:22 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25113 exited with status 0
2013-06-29 03:18:22 [DEBUG   ] 2013-06-29 03:18:22 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25114 exited with status 0
2013-06-29 03:18:22 [DEBUG   ] 2013-06-29 03:18:22 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25115 exited with status 0
2013-06-29 03:18:22 [DEBUG   ] 2013-06-29 03:18:22 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25116 exited with status 0
2013-06-29 03:18:22 [DEBUG   ] 2013-06-29 03:18:22 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25117 exited with status 0
2013-06-29 03:18:22 [DEBUG   ] 2013-06-29 03:18:22 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25118 exited with status 0
2013-06-29 03:18:22 [DEBUG   ] 2013-06-29 03:18:22 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25119 exited with status 0
2013-06-29 03:18:22 [DEBUG   ] 2013-06-29 03:18:22 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25120 exited with status 0
2013-06-29 03:18:22 [DEBUG   ] 2013-06-29 03:18:22 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25121 exited with status 0
2013-06-29 03:18:22 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2013-06-29 03:18:22 [DEBUG   ] spawn_process: at 2013-06-29 03:18:22 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2013-06-29 03:18:22 [DEBUG   ] spawn_process: at 2013-06-29 03:18:22 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2013-06-29 03:18:22 [DEBUG   ] spawn_process: at 2013-06-29 03:18:22 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2013-06-29 03:18:22 [DEBUG   ] spawn_process: at 2013-06-29 03:18:22 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2013-06-29 03:18:22 [DEBUG   ] spawn_process: at 2013-06-29 03:18:22 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2013-06-29 03:18:22 [DEBUG   ] spawn_process: at 2013-06-29 03:18:22 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2013-06-29 03:18:22 [DEBUG   ] spawn_process: at 2013-06-29 03:18:22 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2013-06-29 03:18:22 [DEBUG   ] spawn_process: at 2013-06-29 03:18:22 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2013-06-29 03:18:22 [DEBUG   ] spawn_process: at 2013-06-29 03:18:22 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2013-06-29 03:18:22 [DEBUG   ] spawn_process: at 2013-06-29 03:18:22 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2013-06-29 03:18:22 [DEBUG   ] spawn_process: at 2013-06-29 03:18:22 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2013-06-29 03:18:22 [DEBUG   ] spawn_process: at 2013-06-29 03:18:22 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2013-06-29 03:18:22 [DEBUG   ] spawn_process: at 2013-06-29 03:18:22 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2013-06-29 03:18:22 [DEBUG   ] spawn_process: at 2013-06-29 03:18:22 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2013-06-29 03:18:22 [DEBUG   ] spawn_process: at 2013-06-29 03:18:22 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2013-06-29 03:18:22 [DEBUG   ] spawn_process: at 2013-06-29 03:18:22 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2013-06-29 03:18:22 [DEBUG   ] spawn_process: at 2013-06-29 03:18:22 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2013-06-29 03:18:22 [DEBUG   ] spawn_process: at 2013-06-29 03:18:22 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2013-06-29 03:18:22 [DEBUG   ] spawn_process: at 2013-06-29 03:18:22 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2013-06-29 03:18:22 [DEBUG   ] spawn_process: at 2013-06-29 03:18:22 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2013-06-29 03:18:22 [DEBUG   ] spawn_process: at 2013-06-29 03:18:22 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2013-06-29 03:18:22 [DEBUG   ] spawn_process: at 2013-06-29 03:18:22 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2013-06-29 03:18:22 [DEBUG   ] spawn_process: at 2013-06-29 03:18:22 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2013-06-29 03:18:22 [DEBUG   ] spawn_process: at 2013-06-29 03:18:22 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2013-06-29 03:18:22 [DEBUG   ] spawn_process: at 2013-06-29 03:18:22 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2013-06-29 03:18:22 [DEBUG   ] spawn_process: at 2013-06-29 03:18:22 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2013-06-29 03:18:22 [DEBUG   ] 2013-06-29 03:18:22 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 25148
2013-06-29 03:18:22 [DEBUG   ] 2013-06-29 03:18:22 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 25149
2013-06-29 03:18:28 [DEBUG   ] 2013-06-29 03:18:28 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 25148 exited with status 0
2013-06-29 03:18:28 [DEBUG   ] 2013-06-29 03:18:28 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 25149 exited with status 0
2013-06-29 03:18:28 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2013-06-29 03:18:28 [DEBUG   ] spawn_process: at 2013-06-29 03:18:28 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2013-06-29 03:18:28 [DEBUG   ] spawn_process: at 2013-06-29 03:18:28 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2013-06-29 03:18:28 [INFO    ] Setting Beam 1 xbars
2013-06-29 03:18:28 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2013-06-29 03:18:28 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2013-06-29 03:18:28 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2013-06-29 03:18:28 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2013-06-29 03:18:28 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2013-06-29 03:18:29 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2013-06-29 03:18:29 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2013-06-29 03:18:29 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2013-06-29 03:18:29 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2013-06-29 03:18:29 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2013-06-29 03:18:29 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2013-06-29 03:18:29 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2013-06-29 03:18:29 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2013-06-29 03:18:29 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2013-06-29 03:18:30 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2013-06-29 03:18:30 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2013-06-29 03:18:30 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2013-06-29 03:18:30 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2013-06-29 03:18:30 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2013-06-29 03:18:30 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2013-06-29 03:18:30 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2013-06-29 03:18:30 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2013-06-29 03:18:30 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2013-06-29 03:18:31 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2013-06-29 03:18:31 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2013-06-29 03:18:31 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2013-06-29 03:18:31 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2013-06-29 03:18:31 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2013-06-29 03:18:31 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2013-06-29 03:18:31 [DEBUG   ] Got command RPT from MCS: ref #50503
2013-06-29 03:18:31 [DEBUG   ] summary = BOOTING
2013-06-29 03:18:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50503  15 56472 11911574 ABOOTINGBOOTING'
2013-06-29 03:18:31 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2013-06-29 03:18:31 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2013-06-29 03:18:31 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2013-06-29 03:18:31 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2013-06-29 03:18:32 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2013-06-29 03:18:32 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2013-06-29 03:18:32 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2013-06-29 03:18:32 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2013-06-29 03:18:32 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2013-06-29 03:18:32 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2013-06-29 03:18:32 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2013-06-29 03:18:32 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2013-06-29 03:18:32 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2013-06-29 03:18:33 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2013-06-29 03:18:33 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2013-06-29 03:18:33 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2013-06-29 03:18:33 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2013-06-29 03:18:33 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2013-06-29 03:18:33 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2013-06-29 03:18:33 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2013-06-29 03:18:33 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2013-06-29 03:18:33 [INFO    ] Setting Beam 2 xbars
2013-06-29 03:18:33 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2013-06-29 03:18:34 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2013-06-29 03:18:34 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2013-06-29 03:18:34 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2013-06-29 03:18:34 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2013-06-29 03:18:34 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2013-06-29 03:18:34 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2013-06-29 03:18:34 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2013-06-29 03:18:34 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2013-06-29 03:18:34 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2013-06-29 03:18:35 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2013-06-29 03:18:35 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2013-06-29 03:18:35 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2013-06-29 03:18:35 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2013-06-29 03:18:35 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2013-06-29 03:18:35 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2013-06-29 03:18:35 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2013-06-29 03:18:35 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2013-06-29 03:18:35 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2013-06-29 03:18:36 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2013-06-29 03:18:36 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2013-06-29 03:18:36 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2013-06-29 03:18:36 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2013-06-29 03:18:36 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2013-06-29 03:18:36 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2013-06-29 03:18:36 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2013-06-29 03:18:36 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2013-06-29 03:18:36 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2013-06-29 03:18:36 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2013-06-29 03:18:37 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2013-06-29 03:18:37 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2013-06-29 03:18:37 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2013-06-29 03:18:37 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2013-06-29 03:18:37 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2013-06-29 03:18:37 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2013-06-29 03:18:37 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2013-06-29 03:18:37 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2013-06-29 03:18:37 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2013-06-29 03:18:38 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2013-06-29 03:18:38 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2013-06-29 03:18:38 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2013-06-29 03:18:38 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2013-06-29 03:18:38 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2013-06-29 03:18:38 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2013-06-29 03:18:38 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2013-06-29 03:18:38 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2013-06-29 03:18:38 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2013-06-29 03:18:39 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2013-06-29 03:18:39 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2013-06-29 03:18:39 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2013-06-29 03:18:39 [INFO    ] Setting Beam 3 xbars
2013-06-29 03:18:39 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2013-06-29 03:18:39 [DEBUG   ] Got command RPT from MCS: ref #50504
2013-06-29 03:18:39 [DEBUG   ] summary = BOOTING
2013-06-29 03:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50504  15 56472 11919462 ABOOTINGBOOTING'
2013-06-29 03:18:39 [DEBUG   ] Got command RPT from MCS: ref #50505
2013-06-29 03:18:39 [DEBUG   ] info = Starting calibration
2013-06-29 03:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50505  28 56472 11919462 ABOOTINGStarting calibration'
2013-06-29 03:18:39 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2013-06-29 03:18:39 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2013-06-29 03:18:39 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2013-06-29 03:18:39 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2013-06-29 03:18:39 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2013-06-29 03:18:40 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2013-06-29 03:18:40 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2013-06-29 03:18:40 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2013-06-29 03:18:40 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2013-06-29 03:18:40 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2013-06-29 03:18:40 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2013-06-29 03:18:40 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2013-06-29 03:18:40 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2013-06-29 03:18:40 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2013-06-29 03:18:40 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2013-06-29 03:18:41 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2013-06-29 03:18:41 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2013-06-29 03:18:41 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2013-06-29 03:18:41 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2013-06-29 03:18:41 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2013-06-29 03:18:41 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2013-06-29 03:18:41 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2013-06-29 03:18:41 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2013-06-29 03:18:41 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2013-06-29 03:18:42 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2013-06-29 03:18:42 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2013-06-29 03:18:42 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2013-06-29 03:18:42 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2013-06-29 03:18:42 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2013-06-29 03:18:42 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2013-06-29 03:18:42 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2013-06-29 03:18:42 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2013-06-29 03:18:42 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2013-06-29 03:18:43 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2013-06-29 03:18:43 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2013-06-29 03:18:43 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2013-06-29 03:18:43 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2013-06-29 03:18:43 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2013-06-29 03:18:43 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2013-06-29 03:18:43 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2013-06-29 03:18:43 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2013-06-29 03:18:43 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2013-06-29 03:18:44 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2013-06-29 03:18:44 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2013-06-29 03:18:44 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2013-06-29 03:18:44 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2013-06-29 03:18:44 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2013-06-29 03:18:44 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2013-06-29 03:18:44 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2013-06-29 03:18:44 [INFO    ] Setting Beam 4 xbars
2013-06-29 03:18:44 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2013-06-29 03:18:44 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2013-06-29 03:18:45 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2013-06-29 03:18:45 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2013-06-29 03:18:45 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2013-06-29 03:18:45 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2013-06-29 03:18:45 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2013-06-29 03:18:45 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2013-06-29 03:18:45 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2013-06-29 03:18:45 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2013-06-29 03:18:45 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2013-06-29 03:18:45 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2013-06-29 03:18:46 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2013-06-29 03:18:46 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2013-06-29 03:18:46 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2013-06-29 03:18:46 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2013-06-29 03:18:46 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2013-06-29 03:18:46 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2013-06-29 03:18:46 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2013-06-29 03:18:46 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2013-06-29 03:18:46 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2013-06-29 03:18:47 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2013-06-29 03:18:47 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2013-06-29 03:18:47 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2013-06-29 03:18:47 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2013-06-29 03:18:47 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2013-06-29 03:18:47 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2013-06-29 03:18:47 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2013-06-29 03:18:47 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2013-06-29 03:18:47 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2013-06-29 03:18:48 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2013-06-29 03:18:48 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2013-06-29 03:18:48 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2013-06-29 03:18:48 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2013-06-29 03:18:48 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2013-06-29 03:18:48 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2013-06-29 03:18:48 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2013-06-29 03:18:48 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2013-06-29 03:18:48 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2013-06-29 03:18:49 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2013-06-29 03:18:49 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2013-06-29 03:18:49 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2013-06-29 03:18:49 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2013-06-29 03:18:49 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2013-06-29 03:18:49 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2013-06-29 03:18:49 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2013-06-29 03:18:49 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2013-06-29 03:18:49 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2013-06-29 03:18:49 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2013-06-29 03:18:50 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2013-06-29 03:18:50 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2013-06-29 03:18:50 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2013-06-29 03:18:50 [INFO    ] All xbars set
2013-06-29 03:18:50 [INFO    ] Setting adder chain routing for all beams
2013-06-29 03:18:55 [INFO    ] Setting beam ids
2013-06-29 03:19:01 [DEBUG   ] Got command RPT from MCS: ref #50521
2013-06-29 03:19:01 [DEBUG   ] summary = BOOTING
2013-06-29 03:19:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50521  15 56472 11941245 ABOOTINGBOOTING'
2013-06-29 03:19:05 [INFO    ] Starting beam delay calibration
2013-06-29 03:19:17 [INFO    ] Beam 1 latency is 5744
2013-06-29 03:19:17 [INFO    ] Beam 2 latency is 5789
2013-06-29 03:19:17 [INFO    ] Beam 3 latency is 5749
2013-06-29 03:19:17 [INFO    ] Beam 4 latency is 5749
2013-06-29 03:19:17 [INFO    ] Stop calibration
2013-06-29 03:19:19 [DEBUG   ] Got command RPT from MCS: ref #50522
2013-06-29 03:19:19 [DEBUG   ] summary = BOOTING
2013-06-29 03:19:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50522  15 56472 11959093 ABOOTINGBOOTING'
2013-06-29 03:19:25 [INFO    ] Beam delay calibration successful
2013-06-29 03:19:25 [INFO    ] Calibration passed
2013-06-29 03:19:25 [DEBUG   ] spawn_process: at 2013-06-29 03:19:25 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2013-06-29 03:19:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2013-06-29 03:19:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2013-06-29 03:19:25 [DEBUG   ] spawn_process: at 2013-06-29 03:19:25 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2013-06-29 03:19:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2013-06-29 03:19:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2013-06-29 03:19:25 [DEBUG   ] spawn_process: at 2013-06-29 03:19:25 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2013-06-29 03:19:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2013-06-29 03:19:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2013-06-29 03:19:25 [DEBUG   ] spawn_process: at 2013-06-29 03:19:25 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2013-06-29 03:19:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2013-06-29 03:19:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2013-06-29 03:19:25 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2013-06-29 03:19:26 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 76 ms (1372475966.076 s) with PID 26723 and time 1372475965
2013-06-29 03:19:26 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2013-06-29 03:19:26 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 165 ms (1372475966.165 s) with PID 26726 and time 1372475965
2013-06-29 03:19:27 [INFO    ] Started antennas statistics background thread
2013-06-29 03:19:27 [INFO    ] Started board flags background thread
2013-06-29 03:19:27 [INFO    ] Started BAM background thread
2013-06-29 03:19:27 [DEBUG   ] Finished updating ant stats in 1.110 seconds
2013-06-29 03:19:27 [INFO    ] Finished the INI process (ref. #50498) in 105.008 s
2013-06-29 03:19:28 [DEBUG   ] Got command RPT from MCS: ref #50523
2013-06-29 03:19:28 [DEBUG   ] summary = NORMAL
2013-06-29 03:19:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50523  14 56472 11968066 A NORMALNORMAL'
2013-06-29 03:19:28 [DEBUG   ] Finished updating board flags in 1.271 seconds
2013-06-29 03:19:40 [DEBUG   ] Got command TBN from MCS: ref #50524
2013-06-29 03:19:40 [DEBUG   ] spawn_process: at 2013-06-29 03:19:40 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '1', '1372475982']
2013-06-29 03:19:40 [DEBUG   ] spawn_process: at 2013-06-29 03:19:40 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '2', '1372475982']
2013-06-29 03:19:40 [DEBUG   ] tbn = exited with status True, code 0x00
2013-06-29 03:19:40 [DEBUG   ] spawn_process: at 2013-06-29 03:19:40 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '3', '1372475982']
2013-06-29 03:19:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN    50524   8 56472 11980606 A NORMAL'
2013-06-29 03:19:40 [DEBUG   ] spawn_process: at 2013-06-29 03:19:40 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '4', '1372475982']
2013-06-29 03:19:40 [DEBUG   ] spawn_process: at 2013-06-29 03:19:40 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '5', '1372475982']
2013-06-29 03:19:40 [DEBUG   ] spawn_process: at 2013-06-29 03:19:40 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '6', '1372475982']
2013-06-29 03:19:40 [DEBUG   ] spawn_process: at 2013-06-29 03:19:40 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '7', '1372475982']
2013-06-29 03:19:40 [DEBUG   ] spawn_process: at 2013-06-29 03:19:40 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '8', '1372475982']
2013-06-29 03:19:40 [DEBUG   ] spawn_process: at 2013-06-29 03:19:40 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '9', '1372475982']
2013-06-29 03:19:40 [DEBUG   ] spawn_process: at 2013-06-29 03:19:40 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '10', '1372475982']
2013-06-29 03:19:40 [DEBUG   ] spawn_process: at 2013-06-29 03:19:40 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '11', '1372475982']
2013-06-29 03:19:40 [DEBUG   ] spawn_process: at 2013-06-29 03:19:40 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '12', '1372475982']
2013-06-29 03:19:40 [DEBUG   ] spawn_process: at 2013-06-29 03:19:40 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '13', '1372475982']
2013-06-29 03:19:40 [DEBUG   ] spawn_process: at 2013-06-29 03:19:40 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '14', '1372475982']
2013-06-29 03:19:40 [DEBUG   ] spawn_process: at 2013-06-29 03:19:40 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '15', '1372475982']
2013-06-29 03:19:40 [DEBUG   ] spawn_process: at 2013-06-29 03:19:40 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '16', '1372475982']
2013-06-29 03:19:40 [DEBUG   ] spawn_process: at 2013-06-29 03:19:40 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '17', '1372475982']
2013-06-29 03:19:40 [DEBUG   ] spawn_process: at 2013-06-29 03:19:40 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '18', '1372475982']
2013-06-29 03:19:40 [DEBUG   ] spawn_process: at 2013-06-29 03:19:40 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '19', '1372475982']
2013-06-29 03:19:40 [DEBUG   ] spawn_process: at 2013-06-29 03:19:40 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '20', '1372475982']
2013-06-29 03:19:40 [DEBUG   ] spawn_process: at 2013-06-29 03:19:40 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '21', '1372475982']
2013-06-29 03:19:40 [DEBUG   ] spawn_process: at 2013-06-29 03:19:40 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '22', '1372475982']
2013-06-29 03:19:40 [DEBUG   ] spawn_process: at 2013-06-29 03:19:40 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '23', '1372475982']
2013-06-29 03:19:40 [DEBUG   ] spawn_process: at 2013-06-29 03:19:40 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '24', '1372475982']
2013-06-29 03:19:40 [DEBUG   ] spawn_process: at 2013-06-29 03:19:40 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '25', '1372475982']
2013-06-29 03:19:40 [DEBUG   ] spawn_process: at 2013-06-29 03:19:40 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '26', '1372475982']
2013-06-29 03:19:40 [INFO    ] Finished spawning TBN in 0.048 s
2013-06-29 03:19:47 [DEBUG   ] Finished updating ant stats in 1.040 seconds
2013-06-29 03:20:07 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 03:20:27 [DEBUG   ] Finished updating ant stats in 1.049 seconds
2013-06-29 03:20:28 [DEBUG   ] Finished updating board flags in 1.417 seconds
2013-06-29 03:20:47 [DEBUG   ] Finished updating ant stats in 0.953 seconds
2013-06-29 03:21:07 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 03:21:27 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2013-06-29 03:21:28 [DEBUG   ] Finished updating board flags in 1.392 seconds
2013-06-29 03:21:47 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2013-06-29 03:22:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-29 03:22:27 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 03:22:29 [DEBUG   ] Finished updating board flags in 2.213 seconds
2013-06-29 03:22:47 [DEBUG   ] Finished updating ant stats in 0.407 seconds
2013-06-29 03:23:08 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-29 03:23:28 [DEBUG   ] Finished updating ant stats in 1.250 seconds
2013-06-29 03:23:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2013-06-29 03:23:29 [DEBUG   ] Finished updating board flags in 2.185 seconds
2013-06-29 03:23:39 [DEBUG   ] Got command RPT from MCS: ref #50526
2013-06-29 03:23:39 [DEBUG   ] summary = NORMAL
2013-06-29 03:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50526  14 56472 12219469 A NORMALNORMAL'
2013-06-29 03:23:39 [DEBUG   ] Got command RPT from MCS: ref #50527
2013-06-29 03:23:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 03:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50527  48 56472 12219470 A NORMALSystem calibrated and operating normally'
2013-06-29 03:23:48 [DEBUG   ] Finished updating ant stats in 1.158 seconds
2013-06-29 03:24:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 03:24:28 [DEBUG   ] Finished updating ant stats in 1.047 seconds
2013-06-29 03:24:29 [DEBUG   ] Finished updating board flags in 2.011 seconds
2013-06-29 03:24:48 [DEBUG   ] Finished updating ant stats in 0.956 seconds
2013-06-29 03:25:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 03:25:28 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2013-06-29 03:25:29 [DEBUG   ] Finished updating board flags in 1.989 seconds
2013-06-29 03:25:48 [DEBUG   ] Finished updating ant stats in 0.753 seconds
2013-06-29 03:26:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 03:26:28 [DEBUG   ] Finished updating ant stats in 0.649 seconds
2013-06-29 03:26:29 [DEBUG   ] Finished updating board flags in 1.821 seconds
2013-06-29 03:26:48 [DEBUG   ] Finished updating ant stats in 0.555 seconds
2013-06-29 03:27:08 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-29 03:27:28 [DEBUG   ] Finished updating ant stats in 0.446 seconds
2013-06-29 03:27:29 [DEBUG   ] Finished updating board flags in 1.789 seconds
2013-06-29 03:27:49 [DEBUG   ] Finished updating ant stats in 1.359 seconds
2013-06-29 03:28:09 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-29 03:28:29 [DEBUG   ] Finished updating ant stats in 1.244 seconds
2013-06-29 03:28:29 [DEBUG   ] Finished updating board flags in 1.669 seconds
2013-06-29 03:28:39 [DEBUG   ] Got command RPT from MCS: ref #50572
2013-06-29 03:28:39 [DEBUG   ] summary = NORMAL
2013-06-29 03:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50572  14 56472 12519473 A NORMALNORMAL'
2013-06-29 03:28:39 [DEBUG   ] Got command RPT from MCS: ref #50573
2013-06-29 03:28:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 03:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50573  48 56472 12519474 A NORMALSystem calibrated and operating normally'
2013-06-29 03:28:49 [DEBUG   ] Finished updating ant stats in 1.157 seconds
2013-06-29 03:29:09 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-29 03:29:29 [DEBUG   ] Finished updating ant stats in 0.844 seconds
2013-06-29 03:29:29 [DEBUG   ] Finished updating board flags in 1.577 seconds
2013-06-29 03:29:49 [DEBUG   ] Finished updating ant stats in 0.757 seconds
2013-06-29 03:30:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-29 03:30:29 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2013-06-29 03:30:30 [DEBUG   ] Finished updating board flags in 2.365 seconds
2013-06-29 03:30:49 [DEBUG   ] Finished updating ant stats in 0.553 seconds
2013-06-29 03:31:09 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2013-06-29 03:31:30 [DEBUG   ] Finished updating ant stats in 1.250 seconds
2013-06-29 03:31:30 [DEBUG   ] Finished updating board flags in 2.251 seconds
2013-06-29 03:31:50 [DEBUG   ] Finished updating ant stats in 1.157 seconds
2013-06-29 03:32:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 03:32:30 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2013-06-29 03:32:30 [DEBUG   ] Finished updating board flags in 2.209 seconds
2013-06-29 03:32:50 [DEBUG   ] Finished updating ant stats in 0.959 seconds
2013-06-29 03:33:06 [DEBUG   ] Got command TBW from MCS: ref #50631
2013-06-29 03:33:06 [DEBUG   ] tbw = exited with status True, code 0x00
2013-06-29 03:33:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    50631   8 56472 12786150 A NORMAL'
2013-06-29 03:33:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-06-29 03:33:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-06-29 03:33:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-06-29 03:33:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-06-29 03:33:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-06-29 03:33:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-06-29 03:33:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-06-29 03:33:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-06-29 03:33:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-06-29 03:33:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-06-29 03:33:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-06-29 03:33:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-06-29 03:33:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-06-29 03:33:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-06-29 03:33:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-06-29 03:33:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-06-29 03:33:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-06-29 03:33:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-06-29 03:33:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-06-29 03:33:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-06-29 03:33:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-06-29 03:33:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-06-29 03:33:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-06-29 03:33:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-06-29 03:33:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-06-29 03:33:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-06-29 03:33:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-06-29 03:33:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-06-29 03:33:09 [DEBUG   ] spawn_process: at 2013-06-29 03:33:09 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-06-29 03:33:09 [DEBUG   ] spawn_process: at 2013-06-29 03:33:09 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-06-29 03:33:09 [DEBUG   ] spawn_process: at 2013-06-29 03:33:09 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-06-29 03:33:09 [DEBUG   ] spawn_process: at 2013-06-29 03:33:09 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-06-29 03:33:09 [DEBUG   ] spawn_process: at 2013-06-29 03:33:09 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-06-29 03:33:09 [DEBUG   ] spawn_process: at 2013-06-29 03:33:09 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-06-29 03:33:09 [DEBUG   ] spawn_process: at 2013-06-29 03:33:09 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-06-29 03:33:09 [DEBUG   ] spawn_process: at 2013-06-29 03:33:09 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-06-29 03:33:09 [DEBUG   ] spawn_process: at 2013-06-29 03:33:09 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-06-29 03:33:09 [DEBUG   ] spawn_process: at 2013-06-29 03:33:09 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-06-29 03:33:09 [DEBUG   ] spawn_process: at 2013-06-29 03:33:09 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-06-29 03:33:09 [DEBUG   ] spawn_process: at 2013-06-29 03:33:09 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-06-29 03:33:09 [DEBUG   ] spawn_process: at 2013-06-29 03:33:09 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-06-29 03:33:09 [DEBUG   ] spawn_process: at 2013-06-29 03:33:09 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-06-29 03:33:09 [DEBUG   ] spawn_process: at 2013-06-29 03:33:09 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-06-29 03:33:09 [DEBUG   ] spawn_process: at 2013-06-29 03:33:09 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-06-29 03:33:09 [DEBUG   ] spawn_process: at 2013-06-29 03:33:09 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-06-29 03:33:09 [DEBUG   ] spawn_process: at 2013-06-29 03:33:09 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-06-29 03:33:09 [DEBUG   ] spawn_process: at 2013-06-29 03:33:09 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-06-29 03:33:09 [DEBUG   ] spawn_process: at 2013-06-29 03:33:09 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-06-29 03:33:09 [DEBUG   ] spawn_process: at 2013-06-29 03:33:09 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-06-29 03:33:09 [DEBUG   ] spawn_process: at 2013-06-29 03:33:09 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-06-29 03:33:09 [DEBUG   ] spawn_process: at 2013-06-29 03:33:09 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-06-29 03:33:09 [DEBUG   ] spawn_process: at 2013-06-29 03:33:09 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-06-29 03:33:09 [DEBUG   ] spawn_process: at 2013-06-29 03:33:09 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-06-29 03:33:09 [DEBUG   ] spawn_process: at 2013-06-29 03:33:09 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-06-29 03:33:09 [INFO    ] Finished spawning TBW
2013-06-29 03:33:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 03:33:30 [DEBUG   ] Finished updating board flags in 2.011 seconds
2013-06-29 03:33:39 [DEBUG   ] Got command RPT from MCS: ref #50634
2013-06-29 03:33:39 [DEBUG   ] summary = NORMAL
2013-06-29 03:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50634  14 56472 12819465 A NORMALNORMAL'
2013-06-29 03:33:39 [DEBUG   ] Got command RPT from MCS: ref #50635
2013-06-29 03:33:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 03:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50635  48 56472 12819466 A NORMALSystem calibrated and operating normally'
2013-06-29 03:34:30 [DEBUG   ] Finished updating board flags in 2.030 seconds
2013-06-29 03:35:30 [DEBUG   ] Finished updating board flags in 2.019 seconds
2013-06-29 03:36:30 [DEBUG   ] Finished updating board flags in 2.018 seconds
2013-06-29 03:36:48 [INFO    ] __waitForTBW - TBW finished in 218.610 s
2013-06-29 03:36:49 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-29 03:36:49 [INFO    ] Started antennas statistics background thread
2013-06-29 03:36:49 [INFO    ] Resuming TBN at 37.900 MHz after TBW acquisition
2013-06-29 03:36:49 [DEBUG   ] spawn_process: at 2013-06-29 03:36:49 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '1', '1372477010']
2013-06-29 03:36:49 [DEBUG   ] spawn_process: at 2013-06-29 03:36:49 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '2', '1372477010']
2013-06-29 03:36:49 [DEBUG   ] spawn_process: at 2013-06-29 03:36:49 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '3', '1372477010']
2013-06-29 03:36:49 [DEBUG   ] spawn_process: at 2013-06-29 03:36:49 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '4', '1372477010']
2013-06-29 03:36:49 [DEBUG   ] spawn_process: at 2013-06-29 03:36:49 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '5', '1372477010']
2013-06-29 03:36:49 [DEBUG   ] spawn_process: at 2013-06-29 03:36:49 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '6', '1372477010']
2013-06-29 03:36:49 [DEBUG   ] spawn_process: at 2013-06-29 03:36:49 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '7', '1372477010']
2013-06-29 03:36:49 [DEBUG   ] spawn_process: at 2013-06-29 03:36:49 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '8', '1372477010']
2013-06-29 03:36:49 [DEBUG   ] spawn_process: at 2013-06-29 03:36:49 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '9', '1372477010']
2013-06-29 03:36:49 [DEBUG   ] spawn_process: at 2013-06-29 03:36:49 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '10', '1372477010']
2013-06-29 03:36:49 [DEBUG   ] spawn_process: at 2013-06-29 03:36:49 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '11', '1372477010']
2013-06-29 03:36:49 [DEBUG   ] spawn_process: at 2013-06-29 03:36:49 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '12', '1372477010']
2013-06-29 03:36:49 [DEBUG   ] spawn_process: at 2013-06-29 03:36:49 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '13', '1372477010']
2013-06-29 03:36:49 [DEBUG   ] spawn_process: at 2013-06-29 03:36:49 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '14', '1372477010']
2013-06-29 03:36:49 [DEBUG   ] spawn_process: at 2013-06-29 03:36:49 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '15', '1372477010']
2013-06-29 03:36:49 [DEBUG   ] spawn_process: at 2013-06-29 03:36:49 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '16', '1372477010']
2013-06-29 03:36:49 [DEBUG   ] spawn_process: at 2013-06-29 03:36:49 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '17', '1372477010']
2013-06-29 03:36:49 [DEBUG   ] spawn_process: at 2013-06-29 03:36:49 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '18', '1372477010']
2013-06-29 03:36:49 [DEBUG   ] spawn_process: at 2013-06-29 03:36:49 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '19', '1372477010']
2013-06-29 03:36:49 [DEBUG   ] spawn_process: at 2013-06-29 03:36:49 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '20', '1372477010']
2013-06-29 03:36:49 [DEBUG   ] spawn_process: at 2013-06-29 03:36:49 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '21', '1372477010']
2013-06-29 03:36:49 [DEBUG   ] spawn_process: at 2013-06-29 03:36:49 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '22', '1372477010']
2013-06-29 03:36:49 [DEBUG   ] spawn_process: at 2013-06-29 03:36:49 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '23', '1372477010']
2013-06-29 03:36:49 [DEBUG   ] spawn_process: at 2013-06-29 03:36:49 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '24', '1372477010']
2013-06-29 03:36:49 [DEBUG   ] spawn_process: at 2013-06-29 03:36:49 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '25', '1372477010']
2013-06-29 03:36:49 [DEBUG   ] spawn_process: at 2013-06-29 03:36:49 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '26', '1372477010']
2013-06-29 03:36:49 [INFO    ] Finished spawning TBN in 0.052 s
2013-06-29 03:37:09 [DEBUG   ] Finished updating ant stats in 0.869 seconds
2013-06-29 03:37:29 [DEBUG   ] Finished updating ant stats in 0.861 seconds
2013-06-29 03:37:30 [DEBUG   ] Finished updating board flags in 2.216 seconds
2013-06-29 03:37:49 [DEBUG   ] Finished updating ant stats in 0.743 seconds
2013-06-29 03:38:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-29 03:38:29 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2013-06-29 03:38:30 [DEBUG   ] Finished updating board flags in 2.048 seconds
2013-06-29 03:38:39 [DEBUG   ] Got command RPT from MCS: ref #50659
2013-06-29 03:38:39 [DEBUG   ] summary = NORMAL
2013-06-29 03:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50659  14 56472 13119473 A NORMALNORMAL'
2013-06-29 03:38:39 [DEBUG   ] Got command RPT from MCS: ref #50660
2013-06-29 03:38:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 03:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50660  48 56472 13119474 A NORMALSystem calibrated and operating normally'
2013-06-29 03:38:49 [DEBUG   ] Finished updating ant stats in 0.555 seconds
2013-06-29 03:39:09 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-29 03:39:29 [DEBUG   ] Finished updating ant stats in 0.449 seconds
2013-06-29 03:39:30 [DEBUG   ] Finished updating board flags in 2.021 seconds
2013-06-29 03:39:50 [DEBUG   ] Finished updating ant stats in 1.355 seconds
2013-06-29 03:40:10 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-29 03:40:30 [DEBUG   ] Finished updating ant stats in 1.245 seconds
2013-06-29 03:40:30 [DEBUG   ] Finished updating board flags in 2.049 seconds
2013-06-29 03:40:50 [DEBUG   ] Finished updating ant stats in 1.159 seconds
2013-06-29 03:41:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 03:41:30 [DEBUG   ] Finished updating ant stats in 1.045 seconds
2013-06-29 03:41:30 [DEBUG   ] Finished updating board flags in 2.011 seconds
2013-06-29 03:41:50 [DEBUG   ] Finished updating ant stats in 0.958 seconds
2013-06-29 03:42:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 03:42:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 03:42:30 [DEBUG   ] Finished updating ant stats in 0.844 seconds
2013-06-29 03:42:30 [DEBUG   ] Finished updating board flags in 1.979 seconds
2013-06-29 03:42:50 [DEBUG   ] Finished updating ant stats in 0.753 seconds
2013-06-29 03:43:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 03:43:30 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2013-06-29 03:43:30 [DEBUG   ] Finished updating board flags in 1.827 seconds
2013-06-29 03:43:39 [DEBUG   ] Got command RPT from MCS: ref #50676
2013-06-29 03:43:39 [DEBUG   ] summary = NORMAL
2013-06-29 03:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50676  14 56472 13419469 A NORMALNORMAL'
2013-06-29 03:43:39 [DEBUG   ] Got command RPT from MCS: ref #50677
2013-06-29 03:43:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 03:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50677  48 56472 13419470 A NORMALSystem calibrated and operating normally'
2013-06-29 03:43:50 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2013-06-29 03:44:11 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-29 03:44:30 [DEBUG   ] Finished updating board flags in 1.766 seconds
2013-06-29 03:44:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 03:44:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 03:45:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-29 03:45:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 03:45:30 [DEBUG   ] Finished updating board flags in 1.621 seconds
2013-06-29 03:45:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-29 03:45:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 03:46:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 03:46:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 03:46:30 [DEBUG   ] Finished updating board flags in 1.564 seconds
2013-06-29 03:46:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-29 03:46:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 03:47:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 03:47:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-29 03:47:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 03:47:30 [DEBUG   ] Finished updating board flags in 1.539 seconds
2013-06-29 03:47:31 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-29 03:47:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 03:48:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 03:48:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-29 03:48:31 [DEBUG   ] Finished updating ant stats in 1.047 seconds
2013-06-29 03:48:31 [DEBUG   ] Finished updating board flags in 2.306 seconds
2013-06-29 03:48:39 [DEBUG   ] Got command RPT from MCS: ref #50693
2013-06-29 03:48:39 [DEBUG   ] summary = NORMAL
2013-06-29 03:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50693  14 56472 13719473 A NORMALNORMAL'
2013-06-29 03:48:39 [DEBUG   ] Got command RPT from MCS: ref #50694
2013-06-29 03:48:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 03:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50694  48 56472 13719474 A NORMALSystem calibrated and operating normally'
2013-06-29 03:48:51 [DEBUG   ] Finished updating ant stats in 0.959 seconds
2013-06-29 03:49:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 03:49:31 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2013-06-29 03:49:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 03:49:31 [DEBUG   ] Finished updating board flags in 2.190 seconds
2013-06-29 03:49:51 [DEBUG   ] Finished updating ant stats in 0.761 seconds
2013-06-29 03:50:11 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-29 03:50:31 [DEBUG   ] Finished updating board flags in 2.031 seconds
2013-06-29 03:50:32 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-29 03:50:51 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-29 03:51:11 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-29 03:51:31 [DEBUG   ] Finished updating board flags in 2.145 seconds
2013-06-29 03:51:32 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2013-06-29 03:51:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 03:52:12 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 03:52:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-29 03:52:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-29 03:52:31 [DEBUG   ] Finished updating board flags in 1.834 seconds
2013-06-29 03:52:32 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 03:52:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 03:53:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 03:53:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 03:53:32 [DEBUG   ] Finished updating board flags in 2.707 seconds
2013-06-29 03:53:39 [DEBUG   ] Got command RPT from MCS: ref #50710
2013-06-29 03:53:39 [DEBUG   ] summary = NORMAL
2013-06-29 03:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50710  14 56472 14019473 A NORMALNORMAL'
2013-06-29 03:53:39 [DEBUG   ] Got command RPT from MCS: ref #50711
2013-06-29 03:53:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 03:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50711  48 56472 14019474 A NORMALSystem calibrated and operating normally'
2013-06-29 03:53:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 03:54:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 03:54:31 [DEBUG   ] Finished updating board flags in 1.693 seconds
2013-06-29 03:54:32 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-29 03:54:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 03:55:12 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-29 03:55:31 [DEBUG   ] Finished updating board flags in 1.612 seconds
2013-06-29 03:55:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 03:55:52 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 03:56:12 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-29 03:56:31 [DEBUG   ] Finished updating board flags in 1.545 seconds
2013-06-29 03:56:32 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-29 03:56:52 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-29 03:57:12 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-29 03:57:31 [DEBUG   ] Finished updating board flags in 1.412 seconds
2013-06-29 03:57:33 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-29 03:57:53 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-29 03:58:13 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-29 03:58:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-29 03:58:31 [DEBUG   ] Finished updating board flags in 1.386 seconds
2013-06-29 03:58:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-29 03:58:39 [DEBUG   ] Got command RPT from MCS: ref #50727
2013-06-29 03:58:39 [DEBUG   ] summary = NORMAL
2013-06-29 03:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50727  14 56472 14319473 A NORMALNORMAL'
2013-06-29 03:58:39 [DEBUG   ] Got command RPT from MCS: ref #50728
2013-06-29 03:58:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 03:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50728  48 56472 14319474 A NORMALSystem calibrated and operating normally'
2013-06-29 03:58:53 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 03:59:13 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-29 03:59:32 [DEBUG   ] Finished updating board flags in 2.271 seconds
2013-06-29 03:59:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 03:59:53 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-29 04:00:13 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2013-06-29 04:00:32 [DEBUG   ] Finished updating board flags in 2.245 seconds
2013-06-29 04:00:33 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-29 04:00:53 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2013-06-29 04:01:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-29 04:01:32 [DEBUG   ] Finished updating board flags in 2.113 seconds
2013-06-29 04:01:33 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 04:01:53 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-29 04:02:13 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-06-29 04:02:32 [DEBUG   ] Finished updating board flags in 1.985 seconds
2013-06-29 04:02:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 04:02:54 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 04:03:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 196000019
2013-06-29 04:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 196000019
2013-06-29 04:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 196000019
2013-06-29 04:03:32 [DEBUG   ] Finished updating board flags in 1.810 seconds
2013-06-29 04:03:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-29 04:03:39 [DEBUG   ] Got command RPT from MCS: ref #50744
2013-06-29 04:03:39 [DEBUG   ] summary = NORMAL
2013-06-29 04:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50744  14 56472 14619481 A NORMALNORMAL'
2013-06-29 04:03:39 [DEBUG   ] Got command RPT from MCS: ref #50745
2013-06-29 04:03:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 04:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50745  48 56472 14619482 A NORMALSystem calibrated and operating normally'
2013-06-29 04:03:54 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 04:04:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-29 04:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-29 04:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-29 04:04:32 [DEBUG   ] Finished updating board flags in 1.808 seconds
2013-06-29 04:04:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 04:04:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 04:05:14 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 04:05:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 04:05:32 [DEBUG   ] Finished updating board flags in 1.797 seconds
2013-06-29 04:05:34 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 04:05:54 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 04:06:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 04:06:32 [DEBUG   ] Finished updating board flags in 1.598 seconds
2013-06-29 04:06:34 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 04:06:54 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-29 04:07:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 04:07:32 [DEBUG   ] Finished updating board flags in 1.413 seconds
2013-06-29 04:07:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 04:07:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-29 04:08:14 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 04:08:32 [DEBUG   ] Finished updating board flags in 1.492 seconds
2013-06-29 04:08:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-29 04:08:39 [DEBUG   ] Got command RPT from MCS: ref #50761
2013-06-29 04:08:39 [DEBUG   ] summary = NORMAL
2013-06-29 04:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50761  14 56472 14919477 A NORMALNORMAL'
2013-06-29 04:08:39 [DEBUG   ] Got command RPT from MCS: ref #50762
2013-06-29 04:08:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 04:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50762  48 56472 14919478 A NORMALSystem calibrated and operating normally'
2013-06-29 04:08:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 04:09:14 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 04:09:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-29 04:09:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-29 04:09:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 04:09:33 [DEBUG   ] Finished updating board flags in 2.391 seconds
2013-06-29 04:09:34 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-29 04:09:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 04:10:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 04:10:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 04:10:33 [DEBUG   ] Finished updating board flags in 2.212 seconds
2013-06-29 04:10:34 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2013-06-29 04:10:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-29 04:11:15 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-29 04:11:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 04:11:33 [DEBUG   ] Finished updating board flags in 2.082 seconds
2013-06-29 04:11:35 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-29 04:11:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-29 04:12:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 04:12:33 [DEBUG   ] Finished updating board flags in 2.020 seconds
2013-06-29 04:12:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-29 04:12:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-29 04:13:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 04:13:33 [DEBUG   ] Finished updating board flags in 1.995 seconds
2013-06-29 04:13:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 04:13:39 [DEBUG   ] Got command RPT from MCS: ref #50778
2013-06-29 04:13:39 [DEBUG   ] summary = NORMAL
2013-06-29 04:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50778  14 56472 15219481 A NORMALNORMAL'
2013-06-29 04:13:39 [DEBUG   ] Got command RPT from MCS: ref #50779
2013-06-29 04:13:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 04:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50779  48 56472 15219482 A NORMALSystem calibrated and operating normally'
2013-06-29 04:13:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-29 04:14:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-29 04:14:33 [DEBUG   ] Finished updating board flags in 1.826 seconds
2013-06-29 04:14:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-29 04:14:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 04:15:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-29 04:15:33 [DEBUG   ] Finished updating board flags in 1.836 seconds
2013-06-29 04:15:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-29 04:15:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-29 04:16:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-29 04:16:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 04:16:33 [DEBUG   ] Finished updating board flags in 1.807 seconds
2013-06-29 04:16:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 04:16:55 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 04:17:15 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 04:17:33 [DEBUG   ] Finished updating board flags in 1.736 seconds
2013-06-29 04:17:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 04:17:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 04:18:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 04:18:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-29 04:18:33 [DEBUG   ] Finished updating board flags in 1.653 seconds
2013-06-29 04:18:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 04:18:39 [DEBUG   ] Got command RPT from MCS: ref #50795
2013-06-29 04:18:39 [DEBUG   ] summary = NORMAL
2013-06-29 04:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50795  14 56472 15519485 A NORMALNORMAL'
2013-06-29 04:18:39 [DEBUG   ] Got command RPT from MCS: ref #50796
2013-06-29 04:18:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 04:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50796  48 56472 15519486 A NORMALSystem calibrated and operating normally'
2013-06-29 04:18:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 04:19:15 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-29 04:19:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 04:19:33 [DEBUG   ] Finished updating board flags in 1.536 seconds
2013-06-29 04:19:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-29 04:19:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 04:20:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 04:20:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-29 04:20:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-29 04:20:33 [DEBUG   ] Finished updating board flags in 1.416 seconds
2013-06-29 04:20:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 04:20:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-29 04:21:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 04:21:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 04:21:33 [DEBUG   ] Finished updating board flags in 1.474 seconds
2013-06-29 04:21:35 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 04:21:55 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-29 04:22:16 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-29 04:22:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-29 04:22:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-29 04:22:34 [DEBUG   ] Finished updating board flags in 2.347 seconds
2013-06-29 04:22:36 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-29 04:22:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-29 04:23:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-29 04:23:34 [DEBUG   ] Finished updating board flags in 2.211 seconds
2013-06-29 04:23:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-29 04:23:39 [DEBUG   ] Got command RPT from MCS: ref #50812
2013-06-29 04:23:39 [DEBUG   ] summary = NORMAL
2013-06-29 04:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50812  14 56472 15819481 A NORMALNORMAL'
2013-06-29 04:23:39 [DEBUG   ] Got command RPT from MCS: ref #50813
2013-06-29 04:23:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 04:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50813  48 56472 15819482 A NORMALSystem calibrated and operating normally'
2013-06-29 04:23:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 04:24:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 04:24:34 [DEBUG   ] Finished updating board flags in 2.221 seconds
2013-06-29 04:24:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-29 04:24:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 04:25:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 04:25:34 [DEBUG   ] Finished updating board flags in 2.220 seconds
2013-06-29 04:25:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-29 04:25:56 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-29 04:26:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-29 04:26:34 [DEBUG   ] Finished updating board flags in 2.268 seconds
2013-06-29 04:26:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 04:26:56 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-29 04:27:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 04:27:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 04:27:34 [DEBUG   ] Finished updating board flags in 2.062 seconds
2013-06-29 04:27:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 04:27:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 04:28:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 04:28:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 04:28:34 [DEBUG   ] Finished updating board flags in 2.019 seconds
2013-06-29 04:28:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 04:28:39 [DEBUG   ] Got command RPT from MCS: ref #50829
2013-06-29 04:28:39 [DEBUG   ] summary = NORMAL
2013-06-29 04:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50829  14 56472 16119485 A NORMALNORMAL'
2013-06-29 04:28:39 [DEBUG   ] Got command RPT from MCS: ref #50830
2013-06-29 04:28:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 04:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50830  48 56472 16119486 A NORMALSystem calibrated and operating normally'
2013-06-29 04:28:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 04:29:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 04:29:34 [DEBUG   ] Finished updating board flags in 1.996 seconds
2013-06-29 04:29:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 04:29:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 04:30:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 04:30:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 04:30:34 [DEBUG   ] Finished updating board flags in 1.811 seconds
2013-06-29 04:30:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 04:30:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 04:31:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 04:31:34 [DEBUG   ] Finished updating board flags in 1.838 seconds
2013-06-29 04:31:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 04:31:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 04:32:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 04:32:34 [DEBUG   ] Finished updating board flags in 1.862 seconds
2013-06-29 04:32:36 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-29 04:32:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 04:33:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 04:33:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 04:33:34 [DEBUG   ] Finished updating board flags in 1.696 seconds
2013-06-29 04:33:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 04:33:39 [DEBUG   ] Got command RPT from MCS: ref #50846
2013-06-29 04:33:39 [DEBUG   ] summary = NORMAL
2013-06-29 04:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50846  14 56472 16419489 A NORMALNORMAL'
2013-06-29 04:33:39 [DEBUG   ] Got command RPT from MCS: ref #50847
2013-06-29 04:33:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 04:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50847  48 56472 16419490 A NORMALSystem calibrated and operating normally'
2013-06-29 04:33:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 04:34:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 04:34:34 [DEBUG   ] Finished updating board flags in 1.600 seconds
2013-06-29 04:34:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 04:34:56 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-29 04:35:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 04:35:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-29 04:35:34 [DEBUG   ] Finished updating board flags in 1.394 seconds
2013-06-29 04:35:36 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-29 04:35:57 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-29 04:36:17 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-29 04:36:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 04:36:35 [DEBUG   ] Finished updating board flags in 2.215 seconds
2013-06-29 04:36:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 04:36:57 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-29 04:37:17 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-29 04:37:35 [DEBUG   ] Finished updating board flags in 2.203 seconds
2013-06-29 04:37:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 04:37:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 04:38:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 04:38:35 [DEBUG   ] Finished updating board flags in 2.188 seconds
2013-06-29 04:38:37 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-29 04:38:39 [DEBUG   ] Got command RPT from MCS: ref #50863
2013-06-29 04:38:39 [DEBUG   ] summary = NORMAL
2013-06-29 04:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50863  14 56472 16719489 A NORMALNORMAL'
2013-06-29 04:38:39 [DEBUG   ] Got command RPT from MCS: ref #50864
2013-06-29 04:38:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 04:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50864  48 56472 16719490 A NORMALSystem calibrated and operating normally'
2013-06-29 04:38:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 04:39:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 04:39:35 [DEBUG   ] Finished updating board flags in 2.009 seconds
2013-06-29 04:39:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 04:39:57 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-29 04:40:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 04:40:35 [DEBUG   ] Finished updating board flags in 2.012 seconds
2013-06-29 04:40:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 04:40:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 04:41:17 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-06-29 04:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999823
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999823
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999823
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999823
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-06-29 04:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-06-29 04:41:35 [DEBUG   ] Finished updating board flags in 1.986 seconds
2013-06-29 04:41:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-29 04:41:58 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-29 04:42:18 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999941
2013-06-29 04:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999941
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-29 04:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-29 04:42:35 [DEBUG   ] Finished updating board flags in 1.822 seconds
2013-06-29 04:42:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-29 04:42:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 04:43:18 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-29 04:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-29 04:43:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 04:43:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 04:43:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 04:43:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 04:43:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 04:43:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 04:43:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 04:43:35 [DEBUG   ] Finished updating board flags in 1.779 seconds
2013-06-29 04:43:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 04:43:39 [DEBUG   ] Got command RPT from MCS: ref #50880
2013-06-29 04:43:39 [DEBUG   ] summary = NORMAL
2013-06-29 04:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50880  14 56472 17019485 A NORMALNORMAL'
2013-06-29 04:43:39 [DEBUG   ] Got command RPT from MCS: ref #50881
2013-06-29 04:43:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 04:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50881  48 56472 17019486 A NORMALSystem calibrated and operating normally'
2013-06-29 04:43:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 04:44:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 04:44:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 04:44:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 04:44:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 04:44:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 04:44:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 04:44:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 04:44:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 04:44:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 04:44:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 04:44:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 04:44:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 04:44:35 [DEBUG   ] Finished updating board flags in 1.615 seconds
2013-06-29 04:44:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 04:44:58 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-29 04:45:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 04:45:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 04:45:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 04:45:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 04:45:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 04:45:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 04:45:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 04:45:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 04:45:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 04:45:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 04:45:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 04:45:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 04:45:35 [DEBUG   ] Finished updating board flags in 1.599 seconds
2013-06-29 04:45:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 04:45:58 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 04:46:18 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-29 04:46:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 04:46:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 04:46:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 04:46:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 04:46:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 04:46:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 04:46:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 04:46:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 04:46:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 04:46:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 04:46:35 [DEBUG   ] Finished updating board flags in 1.399 seconds
2013-06-29 04:46:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-29 04:46:59 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-29 04:47:19 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-29 04:47:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 04:47:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 04:47:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 04:47:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 04:47:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 04:47:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 04:47:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 04:47:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 04:47:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 04:47:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 04:47:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 04:47:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 04:47:36 [DEBUG   ] Finished updating board flags in 2.214 seconds
2013-06-29 04:47:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-29 04:47:59 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-29 04:48:19 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-29 04:48:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 04:48:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 04:48:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 04:48:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 04:48:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 04:48:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 04:48:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 04:48:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 04:48:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 04:48:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 04:48:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 04:48:36 [DEBUG   ] Finished updating board flags in 2.185 seconds
2013-06-29 04:48:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 04:48:39 [DEBUG   ] Got command RPT from MCS: ref #50897
2013-06-29 04:48:39 [DEBUG   ] summary = NORMAL
2013-06-29 04:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50897  14 56472 17319489 A NORMALNORMAL'
2013-06-29 04:48:39 [DEBUG   ] Got command RPT from MCS: ref #50898
2013-06-29 04:48:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 04:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50898  48 56472 17319490 A NORMALSystem calibrated and operating normally'
2013-06-29 04:48:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 04:49:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 04:49:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 04:49:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 04:49:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 04:49:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 04:49:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 04:49:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-29 04:49:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 04:49:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 04:49:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 04:49:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 04:49:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 04:49:36 [DEBUG   ] Finished updating board flags in 2.018 seconds
2013-06-29 04:49:39 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-29 04:49:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 04:50:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 04:50:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 04:50:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 04:50:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 04:50:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 04:50:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 04:50:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 04:50:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 04:50:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 04:50:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 04:50:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 04:50:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 04:50:36 [DEBUG   ] Finished updating board flags in 1.995 seconds
2013-06-29 04:50:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-29 04:50:59 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-29 04:51:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 04:51:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 04:51:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 04:51:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 04:51:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 04:51:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 04:51:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 04:51:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 04:51:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 04:51:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 04:51:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 04:51:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 04:51:36 [DEBUG   ] Finished updating board flags in 1.800 seconds
2013-06-29 04:51:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 04:51:59 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-29 04:52:19 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-29 04:52:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 04:52:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 04:52:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 04:52:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 04:52:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 04:52:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 04:52:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 04:52:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 04:52:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 04:52:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 04:52:36 [DEBUG   ] Finished updating board flags in 1.648 seconds
2013-06-29 04:52:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-29 04:52:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-29 04:53:19 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-06-29 04:53:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 04:53:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 04:53:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 04:53:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 04:53:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 04:53:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 04:53:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 04:53:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 04:53:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 04:53:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 04:53:36 [DEBUG   ] Finished updating board flags in 1.552 seconds
2013-06-29 04:53:39 [DEBUG   ] Got command RPT from MCS: ref #50914
2013-06-29 04:53:39 [DEBUG   ] summary = NORMAL
2013-06-29 04:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50914  14 56472 17619489 A NORMALNORMAL'
2013-06-29 04:53:39 [DEBUG   ] Got command RPT from MCS: ref #50915
2013-06-29 04:53:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 04:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50915  48 56472 17619490 A NORMALSystem calibrated and operating normally'
2013-06-29 04:53:40 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-29 04:54:00 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-29 04:54:20 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 04:54:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 04:54:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 04:54:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 04:54:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 04:54:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 04:54:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 04:54:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 04:54:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 04:54:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 04:54:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 04:54:36 [DEBUG   ] Finished updating board flags in 1.417 seconds
2013-06-29 04:54:40 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 04:55:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 04:55:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 04:55:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 04:55:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 04:55:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 04:55:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 04:55:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 04:55:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 04:55:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 04:55:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 04:55:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 04:55:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 04:55:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 04:55:36 [DEBUG   ] Finished updating board flags in 1.389 seconds
2013-06-29 04:55:40 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 04:56:00 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 04:56:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 04:56:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 04:56:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 04:56:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 04:56:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 04:56:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 04:56:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 04:56:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 04:56:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 04:56:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 04:56:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 04:56:37 [DEBUG   ] Finished updating board flags in 2.204 seconds
2013-06-29 04:56:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 04:57:00 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 04:57:20 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-29 04:57:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 04:57:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 04:57:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 04:57:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 04:57:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 04:57:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 04:57:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 04:57:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 04:57:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 04:57:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 04:57:37 [DEBUG   ] Finished updating board flags in 2.249 seconds
2013-06-29 04:57:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 04:58:00 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 04:58:20 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-29 04:58:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 04:58:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 04:58:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 04:58:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 04:58:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 04:58:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 04:58:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 04:58:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 04:58:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 04:58:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 04:58:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 04:58:37 [DEBUG   ] Finished updating board flags in 2.143 seconds
2013-06-29 04:58:39 [DEBUG   ] Got command RPT from MCS: ref #50931
2013-06-29 04:58:39 [DEBUG   ] summary = NORMAL
2013-06-29 04:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50931  14 56472 17919489 A NORMALNORMAL'
2013-06-29 04:58:39 [DEBUG   ] Got command RPT from MCS: ref #50932
2013-06-29 04:58:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 04:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50932  48 56472 17919490 A NORMALSystem calibrated and operating normally'
2013-06-29 04:58:40 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-29 04:59:01 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-29 04:59:21 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-06-29 04:59:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 04:59:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 04:59:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 04:59:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 04:59:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 04:59:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 04:59:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 04:59:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 04:59:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 04:59:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 04:59:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 04:59:37 [DEBUG   ] Finished updating board flags in 2.017 seconds
2013-06-29 04:59:41 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 05:00:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 05:00:21 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 05:00:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 05:00:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 05:00:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 05:00:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 05:00:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 05:00:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 05:00:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 05:00:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 05:00:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 05:00:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 05:00:37 [DEBUG   ] Finished updating board flags in 2.005 seconds
2013-06-29 05:00:41 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-29 05:01:01 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 05:01:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-29 05:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 05:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 05:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 05:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 05:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 05:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 05:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 05:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 05:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 05:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 05:01:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 05:01:37 [DEBUG   ] Finished updating board flags in 1.996 seconds
2013-06-29 05:01:41 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 05:02:01 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-29 05:02:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-29 05:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 05:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 05:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 05:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 05:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 05:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 05:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 05:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 05:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 05:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 05:02:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 05:02:37 [DEBUG   ] Finished updating board flags in 1.795 seconds
2013-06-29 05:02:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 05:03:01 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2013-06-29 05:03:21 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-29 05:03:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 05:03:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 05:03:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 05:03:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 05:03:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 05:03:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 05:03:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 05:03:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 05:03:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 05:03:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 05:03:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 05:03:37 [DEBUG   ] Finished updating board flags in 1.611 seconds
2013-06-29 05:03:39 [DEBUG   ] Got command RPT from MCS: ref #50948
2013-06-29 05:03:39 [DEBUG   ] summary = NORMAL
2013-06-29 05:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50948  14 56472 18219489 A NORMALNORMAL'
2013-06-29 05:03:39 [DEBUG   ] Got command RPT from MCS: ref #50949
2013-06-29 05:03:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 05:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50949  48 56472 18219490 A NORMALSystem calibrated and operating normally'
2013-06-29 05:03:41 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 05:04:02 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-29 05:04:22 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-06-29 05:04:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 05:04:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 05:04:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 05:04:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 05:04:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 05:04:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 05:04:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 05:04:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 05:04:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 05:04:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 05:04:37 [DEBUG   ] Finished updating board flags in 1.600 seconds
2013-06-29 05:04:42 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-29 05:05:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 05:05:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 05:05:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 05:05:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 05:05:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 05:05:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 05:05:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 05:05:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 05:05:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 05:05:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 05:05:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 05:05:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 05:05:37 [DEBUG   ] Finished updating board flags in 1.405 seconds
2013-06-29 05:05:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 05:06:02 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-29 05:06:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 05:06:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 05:06:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 05:06:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 05:06:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 05:06:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 05:06:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 05:06:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 05:06:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 05:06:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 05:06:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 05:06:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 05:06:37 [DEBUG   ] Finished updating board flags in 1.407 seconds
2013-06-29 05:06:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 05:07:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-29 05:07:22 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-29 05:07:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 05:07:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 05:07:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 05:07:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 05:07:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 05:07:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 05:07:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 05:07:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 05:07:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 05:07:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 05:07:37 [DEBUG   ] Finished updating board flags in 1.393 seconds
2013-06-29 05:07:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 05:08:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 05:08:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 05:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 05:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 05:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 05:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 05:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 05:08:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 05:08:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 05:08:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 05:08:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 05:08:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 05:08:38 [DEBUG   ] Finished updating board flags in 2.205 seconds
2013-06-29 05:08:39 [DEBUG   ] Got command RPT from MCS: ref #50965
2013-06-29 05:08:39 [DEBUG   ] summary = NORMAL
2013-06-29 05:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50965  14 56472 18519493 A NORMALNORMAL'
2013-06-29 05:08:39 [DEBUG   ] Got command RPT from MCS: ref #50966
2013-06-29 05:08:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 05:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50966  48 56472 18519494 A NORMALSystem calibrated and operating normally'
2013-06-29 05:08:42 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2013-06-29 05:09:03 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2013-06-29 05:09:22 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-06-29 05:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 05:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 05:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 05:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 05:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 05:09:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 05:09:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 05:09:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 05:09:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 05:09:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 05:09:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 05:09:38 [DEBUG   ] Finished updating board flags in 2.187 seconds
2013-06-29 05:09:43 [DEBUG   ] Finished updating ant stats in 1.391 seconds
2013-06-29 05:10:03 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-29 05:10:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-29 05:10:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 05:10:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 05:10:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 05:10:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 05:10:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 05:10:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 05:10:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 05:10:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 05:10:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 05:10:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 05:10:38 [DEBUG   ] Finished updating board flags in 2.022 seconds
2013-06-29 05:10:43 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 05:11:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 05:11:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 05:11:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 05:11:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 05:11:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 05:11:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 05:11:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 05:11:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 05:11:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 05:11:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 05:11:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 05:11:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 05:11:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 05:11:38 [DEBUG   ] Finished updating board flags in 1.990 seconds
2013-06-29 05:11:43 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-29 05:12:03 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-29 05:12:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 05:12:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 05:12:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 05:12:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 05:12:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 05:12:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 05:12:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 05:12:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 05:12:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 05:12:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 05:12:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 05:12:38 [DEBUG   ] Finished updating board flags in 1.811 seconds
2013-06-29 05:12:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 05:13:03 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-29 05:13:23 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 05:13:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 05:13:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 05:13:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 05:13:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 05:13:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 05:13:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 05:13:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 05:13:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 05:13:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 05:13:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 05:13:38 [DEBUG   ] Finished updating board flags in 1.810 seconds
2013-06-29 05:13:39 [DEBUG   ] Got command RPT from MCS: ref #50982
2013-06-29 05:13:39 [DEBUG   ] summary = NORMAL
2013-06-29 05:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50982  14 56472 18819497 A NORMALNORMAL'
2013-06-29 05:13:39 [DEBUG   ] Got command RPT from MCS: ref #50983
2013-06-29 05:13:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 05:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50983  48 56472 18819498 A NORMALSystem calibrated and operating normally'
2013-06-29 05:13:43 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-29 05:14:03 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-29 05:14:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-29 05:14:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 05:14:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 05:14:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 05:14:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 05:14:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 05:14:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-29 05:14:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 05:14:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 05:14:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 05:14:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 05:14:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 05:14:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 05:14:38 [DEBUG   ] Finished updating board flags in 1.806 seconds
2013-06-29 05:14:43 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 05:15:04 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-29 05:15:24 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-06-29 05:15:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 05:15:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 05:15:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 05:15:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 05:15:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 05:15:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 05:15:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 05:15:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 05:15:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 05:15:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 05:15:38 [DEBUG   ] Finished updating board flags in 1.792 seconds
2013-06-29 05:15:44 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 05:16:04 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-29 05:16:24 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-29 05:16:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 05:16:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 05:16:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 05:16:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 05:16:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 05:16:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 05:16:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 05:16:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 05:16:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 05:16:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 05:16:38 [DEBUG   ] Finished updating board flags in 1.604 seconds
2013-06-29 05:16:44 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 05:17:04 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 05:17:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 05:17:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 05:17:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 05:17:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 05:17:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 05:17:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 05:17:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 05:17:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 05:17:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 05:17:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 05:17:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 05:17:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 05:17:38 [DEBUG   ] Finished updating board flags in 1.595 seconds
2013-06-29 05:17:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 05:18:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 05:18:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 05:18:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 05:18:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 05:18:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 05:18:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 05:18:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 05:18:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 05:18:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 05:18:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 05:18:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 05:18:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 05:18:38 [DEBUG   ] Finished updating board flags in 1.423 seconds
2013-06-29 05:18:39 [DEBUG   ] Got command RPT from MCS: ref #50999
2013-06-29 05:18:39 [DEBUG   ] summary = NORMAL
2013-06-29 05:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    50999  14 56472 19119497 A NORMALNORMAL'
2013-06-29 05:18:39 [DEBUG   ] Got command RPT from MCS: ref #51000
2013-06-29 05:18:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 05:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51000  48 56472 19119498 A NORMALSystem calibrated and operating normally'
2013-06-29 05:18:44 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-29 05:19:05 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2013-06-29 05:19:24 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2013-06-29 05:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 05:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 05:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 05:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 05:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 05:19:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 05:19:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 05:19:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 05:19:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 05:19:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 05:19:38 [DEBUG   ] Finished updating board flags in 1.379 seconds
2013-06-29 05:19:45 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-29 05:20:05 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-29 05:20:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-29 05:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 05:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 05:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 05:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 05:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 05:20:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 05:20:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 05:20:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 05:20:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 05:20:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 05:20:39 [DEBUG   ] Finished updating board flags in 2.210 seconds
2013-06-29 05:20:45 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 05:21:05 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-29 05:21:25 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-29 05:21:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 05:21:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 05:21:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 05:21:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 05:21:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 05:21:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 05:21:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 05:21:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 05:21:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 05:21:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 05:21:39 [DEBUG   ] Finished updating board flags in 2.211 seconds
2013-06-29 05:21:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 05:22:05 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 05:22:25 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-29 05:22:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 05:22:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 05:22:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 05:22:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 05:22:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 05:22:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-29 05:22:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 05:22:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 05:22:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 05:22:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 05:22:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 05:22:39 [DEBUG   ] Finished updating board flags in 2.191 seconds
2013-06-29 05:22:45 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-29 05:23:05 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-29 05:23:25 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 05:23:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 05:23:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 05:23:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 05:23:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 05:23:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 05:23:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 05:23:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 05:23:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 05:23:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 05:23:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 05:23:39 [DEBUG   ] Got command RPT from MCS: ref #51016
2013-06-29 05:23:39 [DEBUG   ] summary = NORMAL
2013-06-29 05:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51016  14 56472 19419493 A NORMALNORMAL'
2013-06-29 05:23:39 [DEBUG   ] Got command RPT from MCS: ref #51017
2013-06-29 05:23:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 05:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51017  48 56472 19419494 A NORMALSystem calibrated and operating normally'
2013-06-29 05:23:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 05:23:39 [DEBUG   ] Finished updating board flags in 2.021 seconds
2013-06-29 05:23:45 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-29 05:24:06 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2013-06-29 05:24:26 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-29 05:24:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 05:24:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 05:24:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 05:24:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 05:24:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 05:24:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 05:24:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 05:24:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 05:24:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 05:24:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 05:24:39 [DEBUG   ] Finished updating board flags in 1.987 seconds
2013-06-29 05:24:46 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-29 05:25:06 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-29 05:25:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-29 05:25:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 05:25:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 05:25:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 05:25:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 05:25:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 05:25:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 05:25:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 05:25:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 05:25:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 05:25:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 05:25:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 05:25:39 [DEBUG   ] Finished updating board flags in 1.802 seconds
2013-06-29 05:25:46 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2013-06-29 05:26:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 05:26:26 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-29 05:26:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 05:26:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 05:26:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 05:26:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 05:26:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 05:26:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 05:26:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 05:26:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 05:26:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 05:26:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 05:26:39 [DEBUG   ] Finished updating board flags in 1.808 seconds
2013-06-29 05:26:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 05:27:06 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 05:27:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 05:27:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 05:27:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 05:27:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 05:27:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 05:27:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 05:27:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 05:27:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 05:27:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 05:27:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 05:27:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 05:27:39 [DEBUG   ] Finished updating board flags in 1.796 seconds
2013-06-29 05:27:46 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-29 05:28:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-29 05:28:26 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-29 05:28:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-29 05:28:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-29 05:28:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-29 05:28:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-29 05:28:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-29 05:28:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-29 05:28:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-29 05:28:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-29 05:28:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-29 05:28:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-29 05:28:39 [DEBUG   ] Got command RPT from MCS: ref #51033
2013-06-29 05:28:39 [DEBUG   ] summary = NORMAL
2013-06-29 05:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51033  14 56472 19719501 A NORMALNORMAL'
2013-06-29 05:28:39 [DEBUG   ] Got command RPT from MCS: ref #51034
2013-06-29 05:28:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 05:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51034  48 56472 19719502 A NORMALSystem calibrated and operating normally'
2013-06-29 05:28:39 [DEBUG   ] Finished updating board flags in 1.630 seconds
2013-06-29 05:28:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 05:29:06 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-29 05:29:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 196000019
2013-06-29 05:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 196000019
2013-06-29 05:29:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 05:29:39 [DEBUG   ] Finished updating board flags in 1.580 seconds
2013-06-29 05:29:46 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-29 05:30:07 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2013-06-29 05:30:26 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-29 05:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-29 05:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-29 05:30:39 [DEBUG   ] Finished updating board flags in 1.424 seconds
2013-06-29 05:30:47 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-29 05:31:07 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-29 05:31:27 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-29 05:31:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 05:31:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 05:31:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 05:31:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 05:31:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 05:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 05:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 05:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 05:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 05:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 05:31:39 [DEBUG   ] Finished updating board flags in 1.378 seconds
2013-06-29 05:31:47 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2013-06-29 05:32:07 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 05:32:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-29 05:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 05:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 05:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 05:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 05:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 05:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 05:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 05:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 05:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 05:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 05:32:40 [DEBUG   ] Finished updating board flags in 2.218 seconds
2013-06-29 05:32:47 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2013-06-29 05:33:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-29 05:33:27 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 05:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 05:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 05:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 05:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 05:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 05:33:39 [DEBUG   ] Got command RPT from MCS: ref #51050
2013-06-29 05:33:39 [DEBUG   ] summary = NORMAL
2013-06-29 05:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51050  14 56472 20019505 A NORMALNORMAL'
2013-06-29 05:33:39 [DEBUG   ] Got command RPT from MCS: ref #51051
2013-06-29 05:33:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 05:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51051  48 56472 20019506 A NORMALSystem calibrated and operating normally'
2013-06-29 05:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 05:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 05:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 05:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 05:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 05:33:40 [DEBUG   ] Finished updating board flags in 2.194 seconds
2013-06-29 05:33:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-29 05:34:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 05:34:27 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 05:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 05:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 05:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 05:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 05:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 05:34:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-29 05:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 05:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 05:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 05:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 05:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 05:34:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 05:34:40 [DEBUG   ] Finished updating board flags in 2.002 seconds
2013-06-29 05:34:47 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2013-06-29 05:35:07 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-29 05:35:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 05:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 05:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 05:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 05:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 05:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 05:35:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 05:35:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 05:35:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 05:35:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 05:35:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 05:35:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 05:35:40 [DEBUG   ] Finished updating board flags in 1.990 seconds
2013-06-29 05:35:47 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2013-06-29 05:36:08 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-29 05:36:28 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-06-29 05:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 05:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 05:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 05:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 05:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 05:36:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 05:36:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 05:36:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 05:36:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 05:36:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 05:36:40 [DEBUG   ] Finished updating board flags in 1.817 seconds
2013-06-29 05:36:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-29 05:37:08 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-29 05:37:28 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2013-06-29 05:37:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 05:37:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 05:37:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 05:37:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 05:37:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 05:37:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 05:37:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 05:37:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 05:37:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 05:37:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 05:37:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-29 05:37:40 [DEBUG   ] Finished updating board flags in 1.797 seconds
2013-06-29 05:37:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 05:38:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 05:38:28 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-29 05:38:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 05:38:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 05:38:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 05:38:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 05:38:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 05:38:39 [DEBUG   ] Got command RPT from MCS: ref #51067
2013-06-29 05:38:39 [DEBUG   ] summary = NORMAL
2013-06-29 05:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51067  14 56472 20319506 A NORMALNORMAL'
2013-06-29 05:38:39 [DEBUG   ] Got command RPT from MCS: ref #51068
2013-06-29 05:38:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 05:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51068  48 56472 20319506 A NORMALSystem calibrated and operating normally'
2013-06-29 05:38:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 05:38:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 05:38:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 05:38:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 05:38:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 05:38:40 [DEBUG   ] Finished updating board flags in 1.600 seconds
2013-06-29 05:38:48 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-29 05:39:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 05:39:28 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 05:39:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 05:39:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 05:39:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 05:39:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 05:39:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 05:39:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 05:39:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 05:39:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 05:39:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 05:39:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 05:39:40 [DEBUG   ] Finished updating board flags in 1.415 seconds
2013-06-29 05:39:48 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-29 05:40:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 05:40:28 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-29 05:40:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 05:40:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 05:40:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 05:40:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 05:40:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 05:40:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 05:40:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 05:40:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 05:40:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 05:40:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 05:40:40 [DEBUG   ] Finished updating board flags in 1.386 seconds
2013-06-29 05:40:48 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2013-06-29 05:41:09 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-29 05:41:29 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2013-06-29 05:41:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 05:41:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 05:41:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 05:41:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 05:41:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 05:41:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 05:41:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 05:41:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 05:41:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 05:41:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 05:41:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 05:41:41 [DEBUG   ] Finished updating board flags in 2.213 seconds
2013-06-29 05:41:49 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 05:42:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-29 05:42:29 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-29 05:42:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 05:42:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 05:42:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 05:42:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 05:42:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 05:42:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 05:42:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 05:42:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 05:42:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 05:42:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 05:42:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 05:42:41 [DEBUG   ] Finished updating board flags in 2.183 seconds
2013-06-29 05:42:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 05:43:09 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 05:43:29 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 05:43:39 [DEBUG   ] Got command RPT from MCS: ref #51084
2013-06-29 05:43:39 [DEBUG   ] summary = NORMAL
2013-06-29 05:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51084  14 56472 20619509 A NORMALNORMAL'
2013-06-29 05:43:39 [DEBUG   ] Got command RPT from MCS: ref #51085
2013-06-29 05:43:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 05:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51085  48 56472 20619510 A NORMALSystem calibrated and operating normally'
2013-06-29 05:43:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 05:43:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 05:43:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 05:43:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 05:43:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 05:43:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 05:43:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 05:43:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 05:43:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 05:43:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 05:43:41 [DEBUG   ] Finished updating board flags in 2.020 seconds
2013-06-29 05:43:49 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-29 05:44:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-29 05:44:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-29 05:44:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 05:44:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 05:44:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 05:44:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 05:44:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 05:44:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 05:44:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 05:44:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 05:44:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 05:44:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 05:44:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 05:44:41 [DEBUG   ] Finished updating board flags in 2.005 seconds
2013-06-29 05:44:49 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-29 05:45:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 05:45:29 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-29 05:45:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 05:45:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 05:45:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 05:45:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 05:45:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 05:45:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 05:45:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 05:45:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 05:45:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 05:45:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 05:45:41 [DEBUG   ] Finished updating board flags in 1.982 seconds
2013-06-29 05:45:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-29 05:46:09 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-29 05:46:30 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2013-06-29 05:46:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 05:46:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 05:46:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 05:46:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 05:46:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 05:46:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-29 05:46:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 05:46:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 05:46:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 05:46:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 05:46:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 05:46:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-29 05:46:41 [DEBUG   ] Finished updating board flags in 1.824 seconds
2013-06-29 05:46:50 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-29 05:47:10 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-29 05:47:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 05:47:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 05:47:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 05:47:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 05:47:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 05:47:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 05:47:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-29 05:47:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 05:47:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 05:47:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 05:47:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 05:47:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 05:47:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-29 05:47:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 05:47:41 [DEBUG   ] Finished updating board flags in 1.794 seconds
2013-06-29 05:47:50 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-29 05:48:10 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 05:48:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 05:48:39 [DEBUG   ] Got command RPT from MCS: ref #51101
2013-06-29 05:48:39 [DEBUG   ] summary = NORMAL
2013-06-29 05:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51101  14 56472 20919501 A NORMALNORMAL'
2013-06-29 05:48:39 [DEBUG   ] Got command RPT from MCS: ref #51102
2013-06-29 05:48:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 05:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51102  48 56472 20919502 A NORMALSystem calibrated and operating normally'
2013-06-29 05:48:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 05:48:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 05:48:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 05:48:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 05:48:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 05:48:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 05:48:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 05:48:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 05:48:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 05:48:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 05:48:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-29 05:48:41 [DEBUG   ] Finished updating board flags in 1.599 seconds
2013-06-29 05:48:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 05:49:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 05:49:30 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-29 05:49:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 05:49:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 05:49:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 05:49:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 05:49:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 05:49:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 05:49:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 05:49:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 05:49:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 05:49:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 05:49:41 [DEBUG   ] Finished updating board flags in 1.437 seconds
2013-06-29 05:49:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 05:50:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 05:50:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-29 05:50:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 05:50:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 05:50:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 05:50:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 05:50:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 05:50:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 05:50:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 05:50:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 05:50:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 05:50:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 05:50:42 [DEBUG   ] Finished updating board flags in 2.406 seconds
2013-06-29 05:50:50 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-29 05:51:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 05:51:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 05:51:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 05:51:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 05:51:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 05:51:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 05:51:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 05:51:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 05:51:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 05:51:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 05:51:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 05:51:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 05:51:42 [DEBUG   ] Finished updating board flags in 2.359 seconds
2013-06-29 05:51:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 05:52:10 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-29 05:52:30 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-29 05:52:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 05:52:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 05:52:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 05:52:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 05:52:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 05:52:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 05:52:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 05:52:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 05:52:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 05:52:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 05:52:42 [DEBUG   ] Finished updating board flags in 2.219 seconds
2013-06-29 05:52:51 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-29 05:53:11 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-29 05:53:31 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-29 05:53:39 [DEBUG   ] Got command RPT from MCS: ref #51118
2013-06-29 05:53:39 [DEBUG   ] summary = NORMAL
2013-06-29 05:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51118  14 56472 21219509 A NORMALNORMAL'
2013-06-29 05:53:39 [DEBUG   ] Got command RPT from MCS: ref #51119
2013-06-29 05:53:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 05:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51119  48 56472 21219510 A NORMALSystem calibrated and operating normally'
2013-06-29 05:53:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 05:53:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 05:53:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 05:53:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 05:53:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 05:53:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 05:53:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 05:53:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 05:53:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 05:53:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 05:53:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 05:53:42 [DEBUG   ] Finished updating board flags in 2.188 seconds
2013-06-29 05:53:51 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-29 05:54:11 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 05:54:31 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 05:54:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 05:54:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 05:54:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 05:54:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 05:54:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 05:54:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 05:54:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 05:54:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 05:54:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 05:54:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 05:54:42 [DEBUG   ] Finished updating board flags in 2.012 seconds
2013-06-29 05:54:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 05:55:11 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-29 05:55:31 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 05:55:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 05:55:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 05:55:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 05:55:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 05:55:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 05:55:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 05:55:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 05:55:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 05:55:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 05:55:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 05:55:42 [DEBUG   ] Finished updating board flags in 1.988 seconds
2013-06-29 05:55:51 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-29 05:56:11 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-29 05:56:32 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-29 05:56:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 05:56:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 05:56:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 05:56:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 05:56:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 05:56:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 05:56:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 05:56:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 05:56:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 05:56:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 05:56:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 05:56:42 [DEBUG   ] Finished updating board flags in 1.810 seconds
2013-06-29 05:56:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 05:57:12 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-29 05:57:32 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-29 05:57:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 05:57:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 05:57:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 05:57:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 05:57:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 05:57:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 05:57:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 05:57:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 05:57:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 05:57:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 05:57:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-29 05:57:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 05:57:42 [DEBUG   ] Finished updating board flags in 1.791 seconds
2013-06-29 05:57:52 [DEBUG   ] Finished updating ant stats in 1.192 seconds
2013-06-29 05:58:12 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-29 05:58:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 05:58:39 [DEBUG   ] Got command RPT from MCS: ref #51135
2013-06-29 05:58:39 [DEBUG   ] summary = NORMAL
2013-06-29 05:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51135  14 56472 21519505 A NORMALNORMAL'
2013-06-29 05:58:39 [DEBUG   ] Got command RPT from MCS: ref #51136
2013-06-29 05:58:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 05:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51136  48 56472 21519506 A NORMALSystem calibrated and operating normally'
2013-06-29 05:58:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 05:58:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 05:58:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 05:58:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 05:58:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 05:58:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 05:58:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 05:58:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 05:58:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 05:58:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 05:58:42 [DEBUG   ] Finished updating board flags in 1.619 seconds
2013-06-29 05:58:52 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-29 05:59:12 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 05:59:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 05:59:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 05:59:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 05:59:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 05:59:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 05:59:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 05:59:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 05:59:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 05:59:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 05:59:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 05:59:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 05:59:42 [DEBUG   ] Finished updating board flags in 1.667 seconds
2013-06-29 05:59:52 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-29 06:00:12 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 06:00:32 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 06:00:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:00:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:00:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:00:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:00:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:00:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:00:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:00:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:00:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:00:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:00:42 [DEBUG   ] Finished updating board flags in 1.610 seconds
2013-06-29 06:00:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 06:01:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 06:01:32 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-29 06:01:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:01:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:01:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:01:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:01:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:01:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:01:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:01:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:01:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:01:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:01:42 [DEBUG   ] Finished updating board flags in 1.524 seconds
2013-06-29 06:01:52 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 06:02:13 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-29 06:02:33 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-06-29 06:02:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:02:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:02:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:02:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:02:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:02:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:02:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:02:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:02:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:02:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:02:42 [DEBUG   ] Finished updating board flags in 1.407 seconds
2013-06-29 06:02:53 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 06:03:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 06:03:33 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-29 06:03:39 [DEBUG   ] Got command RPT from MCS: ref #51152
2013-06-29 06:03:39 [DEBUG   ] summary = NORMAL
2013-06-29 06:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51152  14 56472 21819509 A NORMALNORMAL'
2013-06-29 06:03:39 [DEBUG   ] Got command RPT from MCS: ref #51153
2013-06-29 06:03:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 06:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51153  48 56472 21819510 A NORMALSystem calibrated and operating normally'
2013-06-29 06:03:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:03:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:03:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:03:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:03:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:03:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:03:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:03:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:03:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:03:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:03:42 [DEBUG   ] Finished updating board flags in 1.381 seconds
2013-06-29 06:03:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 06:04:13 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 06:04:33 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-29 06:04:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:04:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:04:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:04:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:04:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:04:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:04:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:04:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:04:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:04:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:04:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 06:04:43 [DEBUG   ] Finished updating board flags in 2.227 seconds
2013-06-29 06:04:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-29 06:05:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-29 06:05:33 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 06:05:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:05:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:05:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:05:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:05:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:05:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:05:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:05:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:05:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:05:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:05:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 06:05:43 [DEBUG   ] Finished updating board flags in 2.211 seconds
2013-06-29 06:05:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 06:06:13 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 06:06:33 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-29 06:06:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:06:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:06:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:06:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:06:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:06:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:06:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:06:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:06:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:06:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:06:43 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 06:06:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 06:06:43 [DEBUG   ] Finished updating board flags in 2.181 seconds
2013-06-29 06:06:53 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 06:07:13 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-29 06:07:34 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-29 06:07:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:07:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:07:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:07:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:07:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:07:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:07:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:07:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:07:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:07:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:07:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 06:07:43 [DEBUG   ] Finished updating board flags in 2.011 seconds
2013-06-29 06:07:54 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-29 06:08:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 06:08:34 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 06:08:39 [DEBUG   ] Got command RPT from MCS: ref #51169
2013-06-29 06:08:39 [DEBUG   ] summary = NORMAL
2013-06-29 06:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51169  14 56472 22119509 A NORMALNORMAL'
2013-06-29 06:08:39 [DEBUG   ] Got command RPT from MCS: ref #51170
2013-06-29 06:08:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 06:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51170  48 56472 22119510 A NORMALSystem calibrated and operating normally'
2013-06-29 06:08:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:08:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:08:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:08:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:08:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:08:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:08:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:08:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:08:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:08:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:08:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 06:08:43 [DEBUG   ] Finished updating board flags in 1.986 seconds
2013-06-29 06:08:54 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 06:09:14 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-29 06:09:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 06:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:09:43 [DEBUG   ] Finished updating board flags in 1.819 seconds
2013-06-29 06:09:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 06:10:14 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 06:10:34 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-29 06:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:10:43 [DEBUG   ] Finished updating board flags in 1.833 seconds
2013-06-29 06:10:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 06:11:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 06:11:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 06:11:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:11:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:11:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:11:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:11:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:11:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:11:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:11:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:11:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:11:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:11:43 [DEBUG   ] Finished updating board flags in 1.763 seconds
2013-06-29 06:11:54 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-29 06:12:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 06:12:34 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 06:12:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:12:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:12:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:12:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:12:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:12:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:12:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:12:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:12:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:12:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:12:43 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 06:12:43 [DEBUG   ] Finished updating board flags in 1.615 seconds
2013-06-29 06:12:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 06:13:14 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-29 06:13:34 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-29 06:13:39 [DEBUG   ] Got command RPT from MCS: ref #51186
2013-06-29 06:13:39 [DEBUG   ] summary = NORMAL
2013-06-29 06:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51186  14 56472 22419509 A NORMALNORMAL'
2013-06-29 06:13:39 [DEBUG   ] Got command RPT from MCS: ref #51187
2013-06-29 06:13:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 06:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51187  48 56472 22419510 A NORMALSystem calibrated and operating normally'
2013-06-29 06:13:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:13:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:13:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:13:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:13:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:13:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:13:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:13:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:13:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:13:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:13:43 [DEBUG   ] Finished updating board flags in 1.578 seconds
2013-06-29 06:13:55 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-29 06:14:15 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-29 06:14:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 06:14:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:14:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:14:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:14:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:14:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:14:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:14:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:14:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:14:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:14:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:14:43 [DEBUG   ] Finished updating board flags in 1.419 seconds
2013-06-29 06:14:55 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-29 06:15:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-29 06:15:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 06:15:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:15:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:15:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:15:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:15:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:15:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:15:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:15:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:15:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:15:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:15:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 06:15:43 [DEBUG   ] Finished updating board flags in 1.386 seconds
2013-06-29 06:15:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 06:16:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 06:16:35 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 06:16:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:16:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:16:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:16:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:16:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:16:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:16:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:16:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:16:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:16:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:16:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 06:16:44 [DEBUG   ] Finished updating board flags in 2.219 seconds
2013-06-29 06:16:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 06:17:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 06:17:35 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-29 06:17:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:17:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:17:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:17:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:17:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:17:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:17:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:17:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:17:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:17:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:17:44 [DEBUG   ] Finished updating board flags in 2.125 seconds
2013-06-29 06:17:55 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2013-06-29 06:18:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 06:18:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 06:18:39 [DEBUG   ] Got command RPT from MCS: ref #51203
2013-06-29 06:18:39 [DEBUG   ] summary = NORMAL
2013-06-29 06:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51203  14 56472 22719513 A NORMALNORMAL'
2013-06-29 06:18:39 [DEBUG   ] Got command RPT from MCS: ref #51204
2013-06-29 06:18:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 06:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51204  48 56472 22719514 A NORMALSystem calibrated and operating normally'
2013-06-29 06:18:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:18:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:18:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:18:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:18:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:18:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:18:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:18:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:18:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:18:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:18:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 06:18:44 [DEBUG   ] Finished updating board flags in 2.014 seconds
2013-06-29 06:18:55 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-29 06:19:15 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-29 06:19:36 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-29 06:19:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:19:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:19:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:19:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:19:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:19:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:19:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:19:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:19:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:19:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:19:44 [DEBUG   ] Finished updating board flags in 1.995 seconds
2013-06-29 06:19:56 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-29 06:20:16 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 06:20:36 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2013-06-29 06:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:20:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:20:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:20:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:20:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:20:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:20:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-29 06:20:44 [DEBUG   ] Finished updating board flags in 1.800 seconds
2013-06-29 06:20:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 06:21:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 06:21:36 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 06:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:21:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:21:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:21:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:21:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:21:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:21:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 06:21:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 06:21:44 [DEBUG   ] Finished updating board flags in 1.613 seconds
2013-06-29 06:21:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 06:22:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 06:22:36 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-29 06:22:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:22:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:22:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:22:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:22:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:22:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:22:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:22:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:22:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:22:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:22:44 [DEBUG   ] Finished updating board flags in 1.594 seconds
2013-06-29 06:22:56 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 06:23:16 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-29 06:23:37 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-29 06:23:39 [DEBUG   ] Got command RPT from MCS: ref #51220
2013-06-29 06:23:39 [DEBUG   ] summary = NORMAL
2013-06-29 06:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51220  14 56472 23019517 A NORMALNORMAL'
2013-06-29 06:23:39 [DEBUG   ] Got command RPT from MCS: ref #51221
2013-06-29 06:23:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 06:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51221  48 56472 23019518 A NORMALSystem calibrated and operating normally'
2013-06-29 06:23:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:23:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:23:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:23:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:23:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:23:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:23:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:23:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:23:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:23:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:23:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 06:23:44 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 06:23:44 [DEBUG   ] Finished updating board flags in 1.409 seconds
2013-06-29 06:23:57 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-29 06:24:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 06:24:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 06:24:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:24:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:24:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:24:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:24:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:24:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:24:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:24:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:24:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:24:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:24:44 [DEBUG   ] Finished updating board flags in 1.389 seconds
2013-06-29 06:24:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-29 06:25:24 [DEBUG   ] Finished updating ant stats in 8.174 seconds
2013-06-29 06:25:38 [DEBUG   ] Finished updating ant stats in 2.003 seconds
2013-06-29 06:25:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:25:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:25:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:25:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:25:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:25:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 06:25:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 06:25:53 [DEBUG   ] Finished updating board flags in 9.752 seconds
2013-06-29 06:25:57 [DEBUG   ] Finished updating ant stats in 1.310 seconds
2013-06-29 06:26:17 [DEBUG   ] Finished updating ant stats in 0.773 seconds
2013-06-29 06:26:37 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 06:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:26:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 06:26:45 [DEBUG   ] Finished updating board flags in 2.060 seconds
2013-06-29 06:26:57 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-29 06:27:17 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-29 06:27:38 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-29 06:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:27:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 06:27:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 06:27:45 [DEBUG   ] Finished updating board flags in 2.000 seconds
2013-06-29 06:27:58 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-29 06:28:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 06:28:38 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 06:28:39 [DEBUG   ] Got command RPT from MCS: ref #51237
2013-06-29 06:28:39 [DEBUG   ] summary = NORMAL
2013-06-29 06:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51237  14 56472 23319513 A NORMALNORMAL'
2013-06-29 06:28:39 [DEBUG   ] Got command RPT from MCS: ref #51238
2013-06-29 06:28:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 06:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51238  48 56472 23319514 A NORMALSystem calibrated and operating normally'
2013-06-29 06:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:28:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:28:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:28:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:28:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:28:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:28:45 [DEBUG   ] Finished updating board flags in 1.815 seconds
2013-06-29 06:28:58 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 06:29:18 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 06:29:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 06:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:29:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:29:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:29:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:29:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:29:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:29:45 [DEBUG   ] Finished updating board flags in 1.778 seconds
2013-06-29 06:29:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-29 06:30:18 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 06:30:38 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 06:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:30:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:30:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:30:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:30:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:30:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:30:45 [DEBUG   ] Finished updating board flags in 1.677 seconds
2013-06-29 06:30:58 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 06:31:18 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2013-06-29 06:31:38 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-06-29 06:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:31:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:31:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:31:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:31:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:31:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:31:45 [DEBUG   ] Finished updating board flags in 1.531 seconds
2013-06-29 06:31:59 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-29 06:32:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 06:32:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 06:32:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:32:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:32:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:32:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:32:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:32:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:32:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:32:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:32:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:32:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:32:45 [DEBUG   ] Finished updating board flags in 1.418 seconds
2013-06-29 06:32:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-29 06:33:19 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 06:33:39 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 06:33:39 [DEBUG   ] Got command RPT from MCS: ref #51254
2013-06-29 06:33:39 [DEBUG   ] summary = NORMAL
2013-06-29 06:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51254  14 56472 23619521 A NORMALNORMAL'
2013-06-29 06:33:39 [DEBUG   ] Got command RPT from MCS: ref #51255
2013-06-29 06:33:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 06:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51255  48 56472 23619522 A NORMALSystem calibrated and operating normally'
2013-06-29 06:33:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:33:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:33:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:33:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:33:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:33:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-29 06:33:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:33:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:33:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:33:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:33:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:33:45 [DEBUG   ] Finished updating board flags in 1.395 seconds
2013-06-29 06:33:59 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 06:34:19 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 06:34:39 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 06:34:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:34:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:34:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:34:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:34:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:34:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:34:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:34:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:34:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:34:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:34:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-29 06:34:46 [DEBUG   ] Finished updating board flags in 2.206 seconds
2013-06-29 06:34:59 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 06:35:19 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 06:35:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-29 06:35:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:35:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:35:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:35:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:35:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:35:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:35:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:35:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:35:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:35:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:35:46 [DEBUG   ] Finished updating board flags in 2.191 seconds
2013-06-29 06:35:59 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 06:36:19 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-29 06:36:39 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 06:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:36:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 06:36:46 [DEBUG   ] Finished updating board flags in 2.055 seconds
2013-06-29 06:36:59 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 06:37:19 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 06:37:39 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-29 06:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:37:46 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 06:37:46 [DEBUG   ] Finished updating board flags in 1.965 seconds
2013-06-29 06:37:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 06:38:19 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 06:38:39 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 06:38:39 [DEBUG   ] Got command RPT from MCS: ref #51271
2013-06-29 06:38:39 [DEBUG   ] summary = NORMAL
2013-06-29 06:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51271  14 56472 23919517 A NORMALNORMAL'
2013-06-29 06:38:39 [DEBUG   ] Got command RPT from MCS: ref #51272
2013-06-29 06:38:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 06:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51272  48 56472 23919518 A NORMALSystem calibrated and operating normally'
2013-06-29 06:38:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:38:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:38:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:38:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:38:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:38:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:38:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:38:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:38:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:38:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:38:46 [DEBUG   ] Finished updating board flags in 1.808 seconds
2013-06-29 06:39:00 [DEBUG   ] Finished updating ant stats in 1.390 seconds
2013-06-29 06:39:20 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-29 06:39:40 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 06:39:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:39:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:39:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:39:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:39:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:39:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:39:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:39:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:39:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:39:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:39:46 [DEBUG   ] Finished updating board flags in 1.784 seconds
2013-06-29 06:40:00 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 06:40:20 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 06:40:40 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 06:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:40:46 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 06:40:46 [DEBUG   ] Finished updating board flags in 1.622 seconds
2013-06-29 06:41:00 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 06:41:20 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-29 06:41:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 06:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:41:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 06:41:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 06:41:46 [DEBUG   ] Finished updating board flags in 1.579 seconds
2013-06-29 06:42:00 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 06:42:20 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 06:42:40 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 06:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:42:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:42:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:42:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:42:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:42:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:42:46 [DEBUG   ] Finished updating board flags in 1.418 seconds
2013-06-29 06:43:00 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 06:43:20 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 06:43:39 [DEBUG   ] Got command RPT from MCS: ref #51288
2013-06-29 06:43:39 [DEBUG   ] summary = NORMAL
2013-06-29 06:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51288  14 56472 24219525 A NORMALNORMAL'
2013-06-29 06:43:39 [DEBUG   ] Got command RPT from MCS: ref #51289
2013-06-29 06:43:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 06:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51289  48 56472 24219526 A NORMALSystem calibrated and operating normally'
2013-06-29 06:43:40 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 06:43:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:43:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:43:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:43:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:43:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:43:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:43:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:43:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:43:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:43:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:43:46 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 06:43:46 [DEBUG   ] Finished updating board flags in 1.418 seconds
2013-06-29 06:44:00 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-29 06:44:20 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-29 06:44:40 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-29 06:44:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:44:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:44:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:44:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:44:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:44:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:44:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:44:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:44:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:44:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:44:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-29 06:44:46 [DEBUG   ] Finished updating board flags in 1.376 seconds
2013-06-29 06:45:01 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-29 06:45:21 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-29 06:45:41 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 06:45:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:45:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:45:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:45:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:45:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:45:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:45:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:45:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:45:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:45:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:45:47 [DEBUG   ] Finished updating board flags in 2.206 seconds
2013-06-29 06:46:01 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 06:46:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 06:46:41 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-29 06:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:46:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:46:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:46:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:46:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:46:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:46:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-29 06:46:47 [DEBUG   ] Finished updating board flags in 2.214 seconds
2013-06-29 06:47:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-29 06:47:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 06:47:41 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 06:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:47:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:47:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:47:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:47:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:47:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:47:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 06:47:47 [DEBUG   ] Finished updating board flags in 2.175 seconds
2013-06-29 06:48:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 06:48:22 [DEBUG   ] Finished updating ant stats in 1.604 seconds
2013-06-29 06:48:39 [DEBUG   ] Got command RPT from MCS: ref #51305
2013-06-29 06:48:39 [DEBUG   ] summary = NORMAL
2013-06-29 06:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51305  14 56472 24519517 A NORMALNORMAL'
2013-06-29 06:48:39 [DEBUG   ] Got command RPT from MCS: ref #51306
2013-06-29 06:48:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 06:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51306  48 56472 24519518 A NORMALSystem calibrated and operating normally'
2013-06-29 06:48:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 06:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:48:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:48:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:48:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:48:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:48:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:48:47 [DEBUG   ] Finished updating board flags in 2.023 seconds
2013-06-29 06:49:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-29 06:49:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-29 06:49:42 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-29 06:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:49:47 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 06:49:47 [DEBUG   ] Finished updating board flags in 2.008 seconds
2013-06-29 06:50:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 06:50:22 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-29 06:50:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 06:50:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:50:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:50:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:50:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:50:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:50:47 [DEBUG   ] Finished updating board flags in 1.983 seconds
2013-06-29 06:51:02 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 06:51:22 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 06:51:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 06:51:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:51:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:51:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:51:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:51:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:51:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:51:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:51:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:51:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:51:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:51:47 [DEBUG   ] Finished updating board flags in 1.813 seconds
2013-06-29 06:52:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 06:52:22 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-29 06:52:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 06:52:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:52:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:52:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:52:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:52:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:52:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:52:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:52:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:52:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:52:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:52:47 [DEBUG   ] Finished updating board flags in 1.796 seconds
2013-06-29 06:53:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 06:53:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 06:53:39 [DEBUG   ] Got command RPT from MCS: ref #51322
2013-06-29 06:53:39 [DEBUG   ] summary = NORMAL
2013-06-29 06:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51322  14 56472 24819525 A NORMALNORMAL'
2013-06-29 06:53:39 [DEBUG   ] Got command RPT from MCS: ref #51323
2013-06-29 06:53:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 06:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51323  48 56472 24819526 A NORMALSystem calibrated and operating normally'
2013-06-29 06:53:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 06:53:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:53:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:53:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:53:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:53:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:53:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:53:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:53:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:53:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:53:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:53:47 [DEBUG   ] Finished updating board flags in 1.689 seconds
2013-06-29 06:54:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 06:54:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 06:54:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 06:54:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:54:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:54:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:54:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:54:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:54:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:54:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:54:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:54:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:54:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:54:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-29 06:54:47 [DEBUG   ] Finished updating board flags in 1.517 seconds
2013-06-29 06:55:02 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-29 06:55:22 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-29 06:55:43 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-29 06:55:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:55:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:55:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:55:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:55:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:55:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:55:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:55:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:55:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:55:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:55:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 06:55:47 [DEBUG   ] Finished updating board flags in 1.471 seconds
2013-06-29 06:56:03 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-29 06:56:23 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 06:56:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 06:56:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:56:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:56:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:56:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:56:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:56:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:56:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:56:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:56:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:56:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:56:48 [DEBUG   ] Finished updating board flags in 2.346 seconds
2013-06-29 06:57:03 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 06:57:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 06:57:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 06:57:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:57:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:57:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:57:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:57:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:57:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:57:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:57:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:57:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:57:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:57:48 [DEBUG   ] Finished updating board flags in 2.209 seconds
2013-06-29 06:58:03 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 06:58:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 06:58:39 [DEBUG   ] Got command RPT from MCS: ref #51339
2013-06-29 06:58:39 [DEBUG   ] summary = NORMAL
2013-06-29 06:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51339  14 56472 25119521 A NORMALNORMAL'
2013-06-29 06:58:39 [DEBUG   ] Got command RPT from MCS: ref #51340
2013-06-29 06:58:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 06:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51340  48 56472 25119522 A NORMALSystem calibrated and operating normally'
2013-06-29 06:58:43 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 06:58:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:58:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:58:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:58:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:58:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:58:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:58:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:58:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:58:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:58:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:58:48 [DEBUG   ] Finished updating board flags in 2.203 seconds
2013-06-29 06:59:03 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 06:59:23 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 06:59:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 06:59:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 06:59:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 06:59:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 06:59:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 06:59:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 06:59:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 06:59:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 06:59:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 06:59:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 06:59:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 06:59:48 [DEBUG   ] Finished updating board flags in 2.174 seconds
2013-06-29 07:00:03 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-29 07:00:24 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-29 07:00:44 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-29 07:00:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:00:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:00:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:00:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:00:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:00:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:00:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:00:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:00:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:00:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:00:48 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 07:00:48 [DEBUG   ] Finished updating board flags in 1.997 seconds
2013-06-29 07:01:04 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-29 07:01:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:01:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:01:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:01:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:01:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:01:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:01:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:01:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:01:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:01:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:01:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:01:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:01:48 [DEBUG   ] Finished updating board flags in 1.807 seconds
2013-06-29 07:02:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 07:02:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:02:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:02:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:02:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:02:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:02:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:02:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:02:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:02:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:02:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:02:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:02:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:02:48 [DEBUG   ] Finished updating board flags in 1.793 seconds
2013-06-29 07:03:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 07:03:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 07:03:39 [DEBUG   ] Got command RPT from MCS: ref #51356
2013-06-29 07:03:39 [DEBUG   ] summary = NORMAL
2013-06-29 07:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51356  14 56472 25419521 A NORMALNORMAL'
2013-06-29 07:03:39 [DEBUG   ] Got command RPT from MCS: ref #51357
2013-06-29 07:03:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 07:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51357  48 56472 25419522 A NORMALSystem calibrated and operating normally'
2013-06-29 07:03:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:03:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:03:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:03:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:03:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:03:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:03:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:03:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:03:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:03:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:03:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:03:48 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 07:03:48 [DEBUG   ] Finished updating board flags in 1.619 seconds
2013-06-29 07:04:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:04:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 07:04:44 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 07:04:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:04:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:04:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:04:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:04:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:04:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:04:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:04:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:04:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:04:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:04:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 07:04:48 [DEBUG   ] Finished updating board flags in 1.575 seconds
2013-06-29 07:05:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:05:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:05:44 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 07:05:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:05:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:05:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:05:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:05:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:05:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:05:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:05:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:05:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:05:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:05:48 [DEBUG   ] Finished updating board flags in 1.537 seconds
2013-06-29 07:06:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 07:06:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:06:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:06:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:06:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:06:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:06:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:06:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:06:49 [DEBUG   ] Finished updating board flags in 2.370 seconds
2013-06-29 07:07:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 07:07:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:07:44 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 07:07:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:07:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:07:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:07:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:07:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:07:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 07:07:49 [DEBUG   ] Finished updating board flags in 2.099 seconds
2013-06-29 07:08:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:08:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 07:08:39 [DEBUG   ] Got command RPT from MCS: ref #51373
2013-06-29 07:08:39 [DEBUG   ] summary = NORMAL
2013-06-29 07:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51373  14 56472 25719521 A NORMALNORMAL'
2013-06-29 07:08:39 [DEBUG   ] Got command RPT from MCS: ref #51374
2013-06-29 07:08:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 07:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51374  48 56472 25719522 A NORMALSystem calibrated and operating normally'
2013-06-29 07:08:44 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 07:08:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:08:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:08:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:08:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:08:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:08:49 [DEBUG   ] Finished updating board flags in 2.047 seconds
2013-06-29 07:09:04 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-29 07:09:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 07:09:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 07:09:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:09:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:09:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:09:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:09:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:09:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:09:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:09:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:09:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:09:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:09:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-29 07:09:49 [DEBUG   ] Finished updating board flags in 2.009 seconds
2013-06-29 07:10:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 07:10:24 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-29 07:10:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 07:10:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:10:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:10:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:10:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:10:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:10:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-29 07:10:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:10:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:10:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:10:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:10:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:10:49 [DEBUG   ] Finished updating board flags in 1.958 seconds
2013-06-29 07:11:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 07:11:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 07:11:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 07:11:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:11:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:11:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:11:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:11:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:11:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:11:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:11:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:11:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:11:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:11:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-29 07:11:49 [DEBUG   ] Finished updating board flags in 1.826 seconds
2013-06-29 07:12:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 07:12:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 07:12:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 07:12:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:12:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:12:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:12:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:12:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:12:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:12:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:12:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:12:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:12:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:12:49 [DEBUG   ] Finished updating board flags in 1.769 seconds
2013-06-29 07:13:04 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-29 07:13:25 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-29 07:13:39 [DEBUG   ] Got command RPT from MCS: ref #51390
2013-06-29 07:13:39 [DEBUG   ] summary = NORMAL
2013-06-29 07:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51390  14 56472 26019529 A NORMALNORMAL'
2013-06-29 07:13:39 [DEBUG   ] Got command RPT from MCS: ref #51391
2013-06-29 07:13:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 07:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51391  48 56472 26019530 A NORMALSystem calibrated and operating normally'
2013-06-29 07:13:45 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-29 07:13:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:13:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:13:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:13:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:13:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:13:49 [DEBUG   ] Finished updating board flags in 1.614 seconds
2013-06-29 07:14:05 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 07:14:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 07:14:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 07:14:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:14:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:14:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:14:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:14:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:14:49 [DEBUG   ] Finished updating board flags in 1.609 seconds
2013-06-29 07:15:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 07:15:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 07:15:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 07:15:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:15:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:15:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:15:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:15:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:15:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:15:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:15:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:15:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:15:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:15:49 [DEBUG   ] Finished updating board flags in 1.617 seconds
2013-06-29 07:16:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:16:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 07:16:45 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-29 07:16:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:16:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:16:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:16:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:16:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:16:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:16:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:16:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:16:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:16:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:16:49 [DEBUG   ] Finished updating board flags in 1.626 seconds
2013-06-29 07:17:05 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-29 07:17:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 07:17:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 07:17:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:17:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:17:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:17:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:17:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:17:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:17:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:17:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:17:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:17:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:17:49 [DEBUG   ] Finished updating board flags in 1.538 seconds
2013-06-29 07:18:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 07:18:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 07:18:39 [DEBUG   ] Got command RPT from MCS: ref #51407
2013-06-29 07:18:39 [DEBUG   ] summary = NORMAL
2013-06-29 07:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51407  14 56472 26319533 A NORMALNORMAL'
2013-06-29 07:18:39 [DEBUG   ] Got command RPT from MCS: ref #51408
2013-06-29 07:18:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 07:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51408  48 56472 26319534 A NORMALSystem calibrated and operating normally'
2013-06-29 07:18:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 07:18:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:18:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:18:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:18:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:18:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:18:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:18:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:18:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:18:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:18:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:18:49 [DEBUG   ] Finished updating board flags in 1.499 seconds
2013-06-29 07:19:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 07:19:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 07:19:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 07:19:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:19:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:19:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:19:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:19:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:19:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-29 07:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:19:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 07:19:50 [DEBUG   ] Finished updating board flags in 2.389 seconds
2013-06-29 07:20:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 07:20:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 07:20:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 07:20:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:20:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:20:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:20:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:20:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:20:50 [DEBUG   ] Finished updating board flags in 2.066 seconds
2013-06-29 07:21:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 07:21:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 07:21:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 07:21:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:21:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:21:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:21:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:21:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:21:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:21:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:21:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:21:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:21:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:21:50 [DEBUG   ] Finished updating board flags in 2.059 seconds
2013-06-29 07:22:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 07:22:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 07:22:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 07:22:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:22:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:22:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:22:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:22:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:22:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:22:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:22:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:22:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:22:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:22:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 07:22:50 [DEBUG   ] Finished updating board flags in 1.944 seconds
2013-06-29 07:23:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 07:23:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 07:23:39 [DEBUG   ] Got command RPT from MCS: ref #51424
2013-06-29 07:23:39 [DEBUG   ] summary = NORMAL
2013-06-29 07:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51424  14 56472 26619525 A NORMALNORMAL'
2013-06-29 07:23:39 [DEBUG   ] Got command RPT from MCS: ref #51425
2013-06-29 07:23:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 07:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51425  48 56472 26619526 A NORMALSystem calibrated and operating normally'
2013-06-29 07:23:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 07:23:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:23:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:23:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:23:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:23:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:23:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:23:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:23:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:23:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:23:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:23:50 [DEBUG   ] Finished updating board flags in 1.834 seconds
2013-06-29 07:24:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 07:24:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 07:24:45 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 07:24:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:24:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:24:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:24:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:24:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:24:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 07:24:50 [DEBUG   ] Finished updating board flags in 1.778 seconds
2013-06-29 07:25:05 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-29 07:25:25 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-29 07:25:46 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-29 07:25:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:25:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:25:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:25:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:25:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:25:50 [DEBUG   ] Finished updating board flags in 1.610 seconds
2013-06-29 07:26:06 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-29 07:26:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 07:26:46 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 07:26:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:26:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:26:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:26:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:26:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:26:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:26:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:26:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:26:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:26:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:26:50 [DEBUG   ] Finished updating board flags in 1.587 seconds
2013-06-29 07:27:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 07:27:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 07:27:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 07:27:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:27:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:27:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:27:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:27:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:27:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:27:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:27:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:27:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:27:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:27:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 07:27:50 [DEBUG   ] Finished updating board flags in 1.506 seconds
2013-06-29 07:28:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 07:28:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 07:28:39 [DEBUG   ] Got command RPT from MCS: ref #51441
2013-06-29 07:28:39 [DEBUG   ] summary = NORMAL
2013-06-29 07:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51441  14 56472 26919533 A NORMALNORMAL'
2013-06-29 07:28:39 [DEBUG   ] Got command RPT from MCS: ref #51442
2013-06-29 07:28:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 07:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51442  48 56472 26919534 A NORMALSystem calibrated and operating normally'
2013-06-29 07:28:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 07:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:28:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:28:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:28:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:28:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:28:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:28:51 [DEBUG   ] Finished updating board flags in 2.429 seconds
2013-06-29 07:29:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 07:29:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 07:29:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 07:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:29:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-29 07:29:51 [DEBUG   ] Finished updating board flags in 2.276 seconds
2013-06-29 07:30:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-29 07:30:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 07:30:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 07:30:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:30:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:30:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:30:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:30:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:30:51 [DEBUG   ] Finished updating board flags in 2.223 seconds
2013-06-29 07:31:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 07:31:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 07:31:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 07:31:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:31:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:31:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:31:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:31:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:31:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:31:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:31:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:31:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:31:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:31:51 [DEBUG   ] Finished updating board flags in 2.176 seconds
2013-06-29 07:32:06 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-29 07:32:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 07:32:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:32:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:32:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:32:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:32:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:32:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:32:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:32:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:32:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:32:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:32:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:32:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 07:32:51 [DEBUG   ] Finished updating board flags in 2.018 seconds
2013-06-29 07:33:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:33:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:33:39 [DEBUG   ] Got command RPT from MCS: ref #51458
2013-06-29 07:33:39 [DEBUG   ] summary = NORMAL
2013-06-29 07:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51458  14 56472 27219537 A NORMALNORMAL'
2013-06-29 07:33:39 [DEBUG   ] Got command RPT from MCS: ref #51459
2013-06-29 07:33:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 07:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51459  48 56472 27219538 A NORMALSystem calibrated and operating normally'
2013-06-29 07:33:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:33:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:33:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:33:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:33:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:33:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:33:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:33:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:33:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:33:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:33:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:33:51 [DEBUG   ] Finished updating board flags in 1.994 seconds
2013-06-29 07:34:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:34:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:34:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:34:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:34:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:34:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:34:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:34:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:34:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:34:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:34:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:34:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:34:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:34:51 [DEBUG   ] Finished updating board flags in 1.900 seconds
2013-06-29 07:35:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:35:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:35:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:35:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:35:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:35:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:35:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:35:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:35:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:35:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:35:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:35:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:35:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:35:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 07:35:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 07:35:51 [DEBUG   ] Finished updating board flags in 1.709 seconds
2013-06-29 07:36:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:36:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:36:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:36:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:36:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:36:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:36:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:36:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:36:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:36:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:36:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:36:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:36:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:36:51 [DEBUG   ] Finished updating board flags in 1.626 seconds
2013-06-29 07:37:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:37:26 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-29 07:37:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 07:37:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:37:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:37:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:37:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:37:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:37:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:37:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:37:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:37:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:37:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:37:51 [DEBUG   ] Finished updating board flags in 1.569 seconds
2013-06-29 07:38:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 07:38:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 07:38:39 [DEBUG   ] Got command RPT from MCS: ref #51475
2013-06-29 07:38:39 [DEBUG   ] summary = NORMAL
2013-06-29 07:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51475  14 56472 27519533 A NORMALNORMAL'
2013-06-29 07:38:39 [DEBUG   ] Got command RPT from MCS: ref #51476
2013-06-29 07:38:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 07:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51476  48 56472 27519534 A NORMALSystem calibrated and operating normally'
2013-06-29 07:38:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 07:38:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:38:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:38:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:38:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:38:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:38:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:38:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:38:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:38:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:38:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:38:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 07:38:51 [DEBUG   ] Finished updating board flags in 1.414 seconds
2013-06-29 07:39:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 07:39:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 07:39:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 07:39:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:39:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:39:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:39:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:39:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:39:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:39:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:39:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:39:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:39:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:39:51 [DEBUG   ] Finished updating board flags in 1.417 seconds
2013-06-29 07:40:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 07:40:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 07:40:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 07:40:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:40:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:40:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:40:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:40:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:40:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:40:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:40:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:40:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:40:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:40:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 07:40:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 07:40:51 [DEBUG   ] Finished updating board flags in 1.495 seconds
2013-06-29 07:41:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 07:41:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 07:41:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 07:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:41:52 [DEBUG   ] Finished updating board flags in 2.408 seconds
2013-06-29 07:42:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 07:42:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 07:42:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 07:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:42:52 [DEBUG   ] Finished updating board flags in 2.181 seconds
2013-06-29 07:43:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 07:43:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 07:43:39 [DEBUG   ] Got command RPT from MCS: ref #51492
2013-06-29 07:43:39 [DEBUG   ] summary = NORMAL
2013-06-29 07:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51492  14 56472 27819529 A NORMALNORMAL'
2013-06-29 07:43:39 [DEBUG   ] Got command RPT from MCS: ref #51493
2013-06-29 07:43:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 07:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51493  48 56472 27819530 A NORMALSystem calibrated and operating normally'
2013-06-29 07:43:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 07:43:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:43:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:43:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:43:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:43:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:43:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:43:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:43:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:43:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:43:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:43:52 [DEBUG   ] Finished updating board flags in 2.013 seconds
2013-06-29 07:44:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 07:44:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 07:44:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 07:44:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:44:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:44:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:44:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:44:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:44:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:44:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:44:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:44:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:44:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:44:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-29 07:44:52 [DEBUG   ] Finished updating board flags in 2.009 seconds
2013-06-29 07:45:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 07:45:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 07:45:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 07:45:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:45:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:45:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:45:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:45:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:45:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:45:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:45:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:45:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:45:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:45:52 [DEBUG   ] Finished updating board flags in 1.976 seconds
2013-06-29 07:46:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 07:46:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 07:46:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 07:46:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:46:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:46:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:46:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:46:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:46:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:46:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:46:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:46:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:46:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:46:52 [DEBUG   ] Finished updating board flags in 1.917 seconds
2013-06-29 07:47:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 07:47:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 07:47:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 07:47:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:47:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:47:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:47:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:47:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:47:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:47:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:47:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:47:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:47:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:47:52 [DEBUG   ] Finished updating board flags in 1.818 seconds
2013-06-29 07:48:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 07:48:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 07:48:39 [DEBUG   ] Got command RPT from MCS: ref #51509
2013-06-29 07:48:39 [DEBUG   ] summary = NORMAL
2013-06-29 07:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51509  14 56472 28119537 A NORMALNORMAL'
2013-06-29 07:48:39 [DEBUG   ] Got command RPT from MCS: ref #51510
2013-06-29 07:48:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 07:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51510  48 56472 28119538 A NORMALSystem calibrated and operating normally'
2013-06-29 07:48:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 07:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:48:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 07:48:52 [DEBUG   ] Finished updating board flags in 1.666 seconds
2013-06-29 07:49:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 07:49:26 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-29 07:49:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 07:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:49:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 07:49:52 [DEBUG   ] Finished updating board flags in 1.619 seconds
2013-06-29 07:50:06 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-29 07:50:26 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2013-06-29 07:50:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 07:50:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:50:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:50:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:50:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:50:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:50:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:50:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:50:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:50:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:50:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:50:52 [DEBUG   ] Finished updating board flags in 1.580 seconds
2013-06-29 07:51:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-29 07:51:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:51:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:51:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:51:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:51:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:51:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:51:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:51:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:51:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:51:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:51:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:51:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:51:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 07:51:52 [DEBUG   ] Finished updating board flags in 1.430 seconds
2013-06-29 07:52:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:52:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:52:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:52:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:52:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:52:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:52:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:52:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:52:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:52:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:52:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:52:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:52:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:52:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-29 07:52:52 [DEBUG   ] Finished updating board flags in 1.381 seconds
2013-06-29 07:53:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:53:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:53:39 [DEBUG   ] Got command RPT from MCS: ref #51526
2013-06-29 07:53:39 [DEBUG   ] summary = NORMAL
2013-06-29 07:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51526  14 56472 28419537 A NORMALNORMAL'
2013-06-29 07:53:39 [DEBUG   ] Got command RPT from MCS: ref #51527
2013-06-29 07:53:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 07:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51527  48 56472 28419538 A NORMALSystem calibrated and operating normally'
2013-06-29 07:53:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:53:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:53:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:53:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:53:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:53:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:53:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-29 07:53:53 [DEBUG   ] Finished updating board flags in 2.222 seconds
2013-06-29 07:54:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:54:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 07:54:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 07:54:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:54:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:54:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:54:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:54:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:54:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:54:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:54:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:54:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:54:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:54:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-29 07:54:53 [DEBUG   ] Finished updating board flags in 2.182 seconds
2013-06-29 07:55:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 07:55:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:55:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 07:55:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:55:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:55:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:55:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:55:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:55:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:55:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:55:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:55:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:55:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:55:53 [DEBUG   ] Finished updating board flags in 2.128 seconds
2013-06-29 07:56:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:56:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 07:56:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:56:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:56:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:56:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:56:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:56:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:56:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:56:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:56:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:56:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:56:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:56:53 [DEBUG   ] Finished updating board flags in 1.883 seconds
2013-06-29 07:57:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 07:57:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:57:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 07:57:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:57:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:57:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:57:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:57:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:57:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:57:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:57:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:57:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:57:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:57:53 [DEBUG   ] Finished updating board flags in 1.828 seconds
2013-06-29 07:58:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:58:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 07:58:39 [DEBUG   ] Got command RPT from MCS: ref #51543
2013-06-29 07:58:39 [DEBUG   ] summary = NORMAL
2013-06-29 07:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51543  14 56472 28719533 A NORMALNORMAL'
2013-06-29 07:58:39 [DEBUG   ] Got command RPT from MCS: ref #51544
2013-06-29 07:58:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 07:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51544  48 56472 28719534 A NORMALSystem calibrated and operating normally'
2013-06-29 07:58:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:58:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:58:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:58:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:58:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:58:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:58:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:58:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:58:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:58:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:58:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:58:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 07:58:53 [DEBUG   ] Finished updating board flags in 1.784 seconds
2013-06-29 07:59:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:59:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 07:59:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 07:59:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 07:59:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 07:59:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 07:59:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 07:59:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 07:59:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 07:59:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 07:59:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 07:59:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 07:59:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 07:59:53 [DEBUG   ] Finished updating board flags in 1.606 seconds
2013-06-29 08:00:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 08:00:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 08:00:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 08:00:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:00:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:00:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:00:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:00:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:00:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:00:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:00:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:00:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:00:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:00:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 08:00:53 [DEBUG   ] Finished updating board flags in 1.692 seconds
2013-06-29 08:01:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 08:01:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 08:01:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 08:01:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:01:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:01:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:01:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:01:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:01:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:01:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:01:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:01:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:01:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:01:53 [DEBUG   ] Finished updating board flags in 1.519 seconds
2013-06-29 08:02:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 08:02:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 08:02:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 08:02:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:02:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:02:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:02:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:02:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:02:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:02:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:02:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:02:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:02:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:02:53 [DEBUG   ] Finished updating board flags in 1.520 seconds
2013-06-29 08:03:07 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2013-06-29 08:03:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 08:03:39 [DEBUG   ] Got command RPT from MCS: ref #51560
2013-06-29 08:03:39 [DEBUG   ] summary = NORMAL
2013-06-29 08:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51560  14 56472 29019534 A NORMALNORMAL'
2013-06-29 08:03:39 [DEBUG   ] Got command RPT from MCS: ref #51561
2013-06-29 08:03:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 08:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51561  48 56472 29019534 A NORMALSystem calibrated and operating normally'
2013-06-29 08:03:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 08:03:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:03:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:03:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:03:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:03:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:03:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-29 08:03:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:03:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:03:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:03:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:03:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:03:54 [DEBUG   ] Finished updating board flags in 2.317 seconds
2013-06-29 08:04:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 08:04:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 08:04:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 08:04:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:04:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:04:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:04:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:04:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:04:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:04:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:04:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:04:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:04:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:04:54 [DEBUG   ] Finished updating board flags in 2.147 seconds
2013-06-29 08:05:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-29 08:05:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 08:05:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 08:05:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:05:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:05:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:05:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:05:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:05:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:05:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:05:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:05:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:05:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:05:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 08:05:54 [DEBUG   ] Finished updating board flags in 2.033 seconds
2013-06-29 08:06:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 08:06:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 08:06:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 08:06:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:06:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:06:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:06:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:06:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:06:54 [DEBUG   ] Finished updating board flags in 1.974 seconds
2013-06-29 08:07:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 08:07:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 08:07:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 08:07:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:07:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:07:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:07:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:07:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:07:54 [DEBUG   ] Finished updating board flags in 1.863 seconds
2013-06-29 08:08:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 08:08:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 08:08:39 [DEBUG   ] Got command RPT from MCS: ref #51577
2013-06-29 08:08:39 [DEBUG   ] summary = NORMAL
2013-06-29 08:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51577  14 56472 29319541 A NORMALNORMAL'
2013-06-29 08:08:39 [DEBUG   ] Got command RPT from MCS: ref #51578
2013-06-29 08:08:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 08:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51578  48 56472 29319542 A NORMALSystem calibrated and operating normally'
2013-06-29 08:08:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 08:08:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:08:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:08:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:08:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:08:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:08:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:08:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:08:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:08:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:08:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:08:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 08:08:54 [DEBUG   ] Finished updating board flags in 1.866 seconds
2013-06-29 08:09:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 08:09:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 08:09:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 08:09:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:09:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:09:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:09:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:09:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:09:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:09:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:09:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:09:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:09:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:09:54 [DEBUG   ] Finished updating board flags in 1.684 seconds
2013-06-29 08:10:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 08:10:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 08:10:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 08:10:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:10:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:10:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:10:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:10:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:10:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:10:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:10:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:10:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:10:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:10:54 [DEBUG   ] Finished updating board flags in 1.621 seconds
2013-06-29 08:11:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 08:11:27 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-29 08:11:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:11:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:11:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:11:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:11:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:11:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:11:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:11:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:11:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:11:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:11:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:11:54 [DEBUG   ] Finished updating board flags in 1.577 seconds
2013-06-29 08:12:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:12:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:12:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:12:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:12:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:12:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:12:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:12:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:12:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:12:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:12:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:12:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:12:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:12:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 08:12:54 [DEBUG   ] Finished updating board flags in 1.413 seconds
2013-06-29 08:13:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:13:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:13:39 [DEBUG   ] Got command RPT from MCS: ref #51594
2013-06-29 08:13:39 [DEBUG   ] summary = NORMAL
2013-06-29 08:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51594  14 56472 29619537 A NORMALNORMAL'
2013-06-29 08:13:39 [DEBUG   ] Got command RPT from MCS: ref #51595
2013-06-29 08:13:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 08:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51595  48 56472 29619538 A NORMALSystem calibrated and operating normally'
2013-06-29 08:13:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:13:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:13:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:13:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:13:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:13:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:13:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-29 08:13:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:13:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:13:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:13:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:13:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:13:54 [DEBUG   ] Finished updating board flags in 1.386 seconds
2013-06-29 08:14:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 08:14:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-29 08:14:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:14:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:14:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:14:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:14:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:14:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:14:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:14:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:14:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:14:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:14:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:14:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-29 08:14:55 [DEBUG   ] Finished updating board flags in 2.327 seconds
2013-06-29 08:15:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:15:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 08:15:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-29 08:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:15:55 [DEBUG   ] Finished updating board flags in 2.078 seconds
2013-06-29 08:16:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:16:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:16:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:16:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 08:16:55 [DEBUG   ] Finished updating board flags in 2.031 seconds
2013-06-29 08:17:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-29 08:17:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:17:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:17:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-29 08:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:17:55 [DEBUG   ] Finished updating board flags in 1.975 seconds
2013-06-29 08:18:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:18:27 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 08:18:39 [DEBUG   ] Got command RPT from MCS: ref #51611
2013-06-29 08:18:39 [DEBUG   ] summary = NORMAL
2013-06-29 08:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51611  14 56472 29919545 A NORMALNORMAL'
2013-06-29 08:18:39 [DEBUG   ] Got command RPT from MCS: ref #51612
2013-06-29 08:18:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 08:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51612  48 56472 29919546 A NORMALSystem calibrated and operating normally'
2013-06-29 08:18:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:18:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-29 08:18:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:18:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:18:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:18:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:18:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:18:55 [DEBUG   ] Finished updating board flags in 1.830 seconds
2013-06-29 08:19:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:19:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:19:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-29 08:19:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:19:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:19:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:19:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:19:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:19:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:19:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:19:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:19:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:19:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:19:55 [DEBUG   ] Finished updating board flags in 1.889 seconds
2013-06-29 08:20:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:20:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:20:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:20:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:20:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:20:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:20:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:20:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:20:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:20:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:20:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:20:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:20:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:20:55 [DEBUG   ] Finished updating board flags in 1.721 seconds
2013-06-29 08:21:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-29 08:21:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:21:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:21:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:21:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:21:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:21:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:21:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:21:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:21:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:21:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:21:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:21:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:21:55 [DEBUG   ] Finished updating board flags in 1.588 seconds
2013-06-29 08:22:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:22:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-29 08:22:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:22:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:22:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:22:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:22:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:22:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:22:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:22:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:22:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:22:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:22:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:22:55 [DEBUG   ] Finished updating board flags in 1.500 seconds
2013-06-29 08:23:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:23:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:23:39 [DEBUG   ] Got command RPT from MCS: ref #51628
2013-06-29 08:23:39 [DEBUG   ] summary = NORMAL
2013-06-29 08:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51628  14 56472 30219545 A NORMALNORMAL'
2013-06-29 08:23:39 [DEBUG   ] Got command RPT from MCS: ref #51629
2013-06-29 08:23:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 08:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51629  48 56472 30219546 A NORMALSystem calibrated and operating normally'
2013-06-29 08:23:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 08:23:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:23:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:23:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:23:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:23:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:23:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-29 08:23:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:23:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:23:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:23:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:23:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:23:56 [DEBUG   ] Finished updating board flags in 2.318 seconds
2013-06-29 08:24:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:24:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:24:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:24:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:24:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:24:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:24:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:24:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:24:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:24:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:24:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:24:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:24:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:24:56 [DEBUG   ] Finished updating board flags in 2.254 seconds
2013-06-29 08:25:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-29 08:25:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:25:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:25:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:25:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:25:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:25:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:25:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:25:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:25:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:25:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:25:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:25:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:25:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-29 08:25:56 [DEBUG   ] Finished updating board flags in 2.233 seconds
2013-06-29 08:26:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:26:27 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 08:26:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:26:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:26:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:26:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:26:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:26:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:26:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:26:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:26:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:26:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:26:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:26:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-29 08:26:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 08:26:56 [DEBUG   ] Finished updating board flags in 2.193 seconds
2013-06-29 08:27:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:27:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:27:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-29 08:27:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:27:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:27:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:27:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:27:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:27:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:27:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:27:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:27:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:27:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:27:56 [DEBUG   ] Finished updating board flags in 1.911 seconds
2013-06-29 08:28:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:28:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:28:39 [DEBUG   ] Got command RPT from MCS: ref #51645
2013-06-29 08:28:39 [DEBUG   ] summary = NORMAL
2013-06-29 08:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51645  14 56472 30519545 A NORMALNORMAL'
2013-06-29 08:28:39 [DEBUG   ] Got command RPT from MCS: ref #51646
2013-06-29 08:28:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 08:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51646  48 56472 30519546 A NORMALSystem calibrated and operating normally'
2013-06-29 08:28:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:28:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:28:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:28:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:28:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:28:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:28:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:28:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:28:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:28:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:28:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:28:56 [DEBUG   ] Finished updating board flags in 1.802 seconds
2013-06-29 08:29:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-29 08:29:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:29:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:29:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:29:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:29:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:29:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:29:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:29:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:29:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:29:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:29:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:29:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:29:56 [DEBUG   ] Finished updating board flags in 1.812 seconds
2013-06-29 08:30:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:30:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-29 08:30:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:30:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:30:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:30:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:30:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:30:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:30:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:30:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:30:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:30:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:30:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:30:56 [DEBUG   ] Finished updating board flags in 1.789 seconds
2013-06-29 08:31:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:31:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:31:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-29 08:31:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:31:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:31:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:31:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:31:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:31:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:31:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:31:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:31:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:31:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:31:56 [DEBUG   ] Finished updating board flags in 1.696 seconds
2013-06-29 08:32:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:32:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-29 08:32:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:32:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:32:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:32:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:32:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:32:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:32:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:32:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:32:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:32:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:32:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:32:56 [DEBUG   ] Finished updating board flags in 1.517 seconds
2013-06-29 08:33:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-29 08:33:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 08:33:39 [DEBUG   ] Got command RPT from MCS: ref #51662
2013-06-29 08:33:39 [DEBUG   ] summary = NORMAL
2013-06-29 08:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51662  14 56472 30819545 A NORMALNORMAL'
2013-06-29 08:33:39 [DEBUG   ] Got command RPT from MCS: ref #51663
2013-06-29 08:33:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 08:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51663  48 56472 30819546 A NORMALSystem calibrated and operating normally'
2013-06-29 08:33:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-29 08:33:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:33:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:33:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:33:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:33:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:33:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:33:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:33:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:33:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:33:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:33:56 [DEBUG   ] Finished updating board flags in 1.496 seconds
2013-06-29 08:34:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-29 08:34:27 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2013-06-29 08:34:48 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-29 08:34:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:34:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:34:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:34:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:34:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:34:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:34:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:34:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:34:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:34:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:34:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 08:34:57 [DEBUG   ] Finished updating board flags in 2.319 seconds
2013-06-29 08:35:08 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-06-29 08:35:28 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2013-06-29 08:35:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 08:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:35:57 [DEBUG   ] Finished updating board flags in 2.166 seconds
2013-06-29 08:36:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 08:36:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 08:36:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 08:36:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:36:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:36:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:36:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:36:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:36:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 08:36:57 [DEBUG   ] Finished updating board flags in 2.011 seconds
2013-06-29 08:37:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 08:37:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 08:37:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 08:37:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:37:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:37:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:37:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:37:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:37:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:37:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:37:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:37:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:37:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:37:57 [DEBUG   ] Finished updating board flags in 2.020 seconds
2013-06-29 08:38:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 08:38:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 08:38:39 [DEBUG   ] Got command RPT from MCS: ref #51679
2013-06-29 08:38:39 [DEBUG   ] summary = NORMAL
2013-06-29 08:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51679  14 56472 31119545 A NORMALNORMAL'
2013-06-29 08:38:39 [DEBUG   ] Got command RPT from MCS: ref #51680
2013-06-29 08:38:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 08:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51680  48 56472 31119546 A NORMALSystem calibrated and operating normally'
2013-06-29 08:38:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 08:38:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:38:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:38:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:38:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:38:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:38:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:38:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:38:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:38:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:38:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:38:57 [DEBUG   ] Finished updating board flags in 2.073 seconds
2013-06-29 08:39:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 08:39:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 08:39:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 08:39:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:39:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:39:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:39:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:39:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:39:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:39:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:39:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:39:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:39:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:39:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 08:39:57 [DEBUG   ] Finished updating board flags in 2.032 seconds
2013-06-29 08:40:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 08:40:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 08:40:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 08:40:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:40:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:40:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:40:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:40:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:40:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:40:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:40:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:40:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:40:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:40:57 [DEBUG   ] Finished updating board flags in 1.899 seconds
2013-06-29 08:41:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 08:41:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 08:41:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 08:41:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:41:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:41:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:41:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:41:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:41:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:41:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:41:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:41:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:41:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:41:57 [DEBUG   ] Finished updating board flags in 1.818 seconds
2013-06-29 08:42:08 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-29 08:42:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-29 08:42:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-29 08:42:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:42:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:42:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:42:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:42:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:42:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:42:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:42:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:42:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:42:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:42:57 [DEBUG   ] Finished updating board flags in 1.777 seconds
2013-06-29 08:43:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-29 08:43:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-29 08:43:39 [DEBUG   ] Got command RPT from MCS: ref #51696
2013-06-29 08:43:39 [DEBUG   ] summary = NORMAL
2013-06-29 08:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51696  14 56472 31419553 A NORMALNORMAL'
2013-06-29 08:43:39 [DEBUG   ] Got command RPT from MCS: ref #51697
2013-06-29 08:43:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 08:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51697  48 56472 31419554 A NORMALSystem calibrated and operating normally'
2013-06-29 08:43:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-29 08:43:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:43:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:43:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:43:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:43:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:43:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:43:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:43:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:43:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:43:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:43:57 [DEBUG   ] Finished updating board flags in 1.613 seconds
2013-06-29 08:44:08 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-29 08:44:28 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-29 08:44:48 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2013-06-29 08:44:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:44:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:44:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:44:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:44:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:44:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:44:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:44:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:44:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:44:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:44:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 08:44:57 [DEBUG   ] Finished updating board flags in 1.586 seconds
2013-06-29 08:45:09 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2013-06-29 08:45:28 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-06-29 08:45:48 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2013-06-29 08:45:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:45:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:45:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:45:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:45:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:45:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:45:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:45:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:45:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:45:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:45:57 [DEBUG   ] Finished updating board flags in 1.410 seconds
2013-06-29 08:46:09 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-29 08:46:29 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2013-06-29 08:46:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-29 08:46:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:46:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:46:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:46:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:46:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:46:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:46:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:46:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:46:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:46:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:46:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 08:46:57 [DEBUG   ] Finished updating board flags in 1.392 seconds
2013-06-29 08:47:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-29 08:47:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 08:47:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-29 08:47:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:47:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:47:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:47:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:47:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:47:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-29 08:47:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:47:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:47:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:47:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:47:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:47:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 08:47:58 [DEBUG   ] Finished updating board flags in 2.209 seconds
2013-06-29 08:48:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-29 08:48:29 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-29 08:48:39 [DEBUG   ] Got command RPT from MCS: ref #51713
2013-06-29 08:48:39 [DEBUG   ] summary = NORMAL
2013-06-29 08:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51713  14 56472 31719545 A NORMALNORMAL'
2013-06-29 08:48:39 [DEBUG   ] Got command RPT from MCS: ref #51714
2013-06-29 08:48:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 08:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51714  48 56472 31719546 A NORMALSystem calibrated and operating normally'
2013-06-29 08:48:49 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 08:48:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:48:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:48:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:48:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:48:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:48:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:48:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:48:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:48:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:48:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:48:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-29 08:48:58 [DEBUG   ] Finished updating board flags in 2.189 seconds
2013-06-29 08:49:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 08:49:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 08:49:49 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 08:49:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:49:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:49:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:49:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:49:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:49:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:49:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:49:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:49:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:49:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:49:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-29 08:49:58 [DEBUG   ] Finished updating board flags in 2.021 seconds
2013-06-29 08:50:09 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 08:50:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 08:50:49 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 08:50:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:50:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:50:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:50:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:50:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:50:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:50:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:50:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:50:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:50:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:50:58 [DEBUG   ] Finished updating board flags in 2.050 seconds
2013-06-29 08:51:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 08:51:29 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 08:51:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-29 08:51:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:51:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:51:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:51:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:51:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:51:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:51:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:51:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:51:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:51:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:51:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-29 08:51:58 [DEBUG   ] Finished updating board flags in 1.922 seconds
2013-06-29 08:52:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-29 08:52:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-29 08:52:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 08:52:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:52:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:52:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:52:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:52:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:52:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:52:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:52:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:52:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:52:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:52:58 [DEBUG   ] Finished updating board flags in 1.873 seconds
2013-06-29 08:53:09 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-29 08:53:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-29 08:53:39 [DEBUG   ] Got command RPT from MCS: ref #51730
2013-06-29 08:53:39 [DEBUG   ] summary = NORMAL
2013-06-29 08:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51730  14 56472 32019553 A NORMALNORMAL'
2013-06-29 08:53:39 [DEBUG   ] Got command RPT from MCS: ref #51731
2013-06-29 08:53:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 08:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51731  48 56472 32019554 A NORMALSystem calibrated and operating normally'
2013-06-29 08:53:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-29 08:53:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:53:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:53:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:53:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:53:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:53:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:53:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:53:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:53:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:53:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:53:58 [DEBUG   ] Finished updating board flags in 1.733 seconds
2013-06-29 08:54:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 08:54:30 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-29 08:54:50 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-29 08:54:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:54:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:54:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:54:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:54:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:54:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:54:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:54:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:54:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:54:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:54:58 [DEBUG   ] Finished updating board flags in 1.626 seconds
2013-06-29 08:55:10 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 08:55:30 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 08:55:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 08:55:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:55:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:55:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:55:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:55:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:55:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:55:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:55:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:55:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:55:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:55:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 08:55:58 [DEBUG   ] Finished updating board flags in 1.574 seconds
2013-06-29 08:56:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 08:56:30 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 08:56:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 08:56:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:56:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:56:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:56:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:56:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:56:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:56:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:56:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:56:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:56:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:56:58 [DEBUG   ] Finished updating board flags in 1.433 seconds
2013-06-29 08:57:10 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2013-06-29 08:57:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-29 08:57:50 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 08:57:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:57:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:57:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:57:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:57:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:57:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:57:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:57:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:57:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:57:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:57:58 [DEBUG   ] Finished updating board flags in 1.375 seconds
2013-06-29 08:58:10 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-29 08:58:30 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2013-06-29 08:58:39 [DEBUG   ] Got command RPT from MCS: ref #51747
2013-06-29 08:58:39 [DEBUG   ] summary = NORMAL
2013-06-29 08:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51747  14 56472 32319553 A NORMALNORMAL'
2013-06-29 08:58:39 [DEBUG   ] Got command RPT from MCS: ref #51748
2013-06-29 08:58:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 08:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51748  48 56472 32319554 A NORMALSystem calibrated and operating normally'
2013-06-29 08:58:50 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2013-06-29 08:58:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:58:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:58:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:58:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:58:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:58:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:58:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:58:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:58:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:58:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:58:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-29 08:58:59 [DEBUG   ] Finished updating board flags in 2.219 seconds
2013-06-29 08:59:11 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-29 08:59:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 08:59:51 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-29 08:59:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 08:59:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 08:59:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 08:59:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 08:59:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 08:59:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 08:59:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 08:59:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 08:59:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 08:59:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 08:59:59 [DEBUG   ] Finished updating board flags in 2.198 seconds
2013-06-29 09:00:11 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 09:00:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-29 09:00:51 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-29 09:00:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:00:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:00:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:00:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:00:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:00:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:00:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:00:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:00:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:00:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:00:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-29 09:00:59 [DEBUG   ] Finished updating board flags in 1.999 seconds
2013-06-29 09:01:11 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-29 09:01:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 09:01:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 09:01:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:01:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:01:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:01:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:01:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:01:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:01:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:01:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:01:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:01:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:01:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-29 09:01:59 [DEBUG   ] Finished updating board flags in 1.816 seconds
2013-06-29 09:02:11 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 09:02:31 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-29 09:02:51 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-29 09:02:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:02:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:02:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:02:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:02:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:02:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:02:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:02:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:02:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:02:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:02:59 [DEBUG   ] Finished updating board flags in 1.809 seconds
2013-06-29 09:03:11 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 09:03:31 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-29 09:03:39 [DEBUG   ] Got command RPT from MCS: ref #51764
2013-06-29 09:03:39 [DEBUG   ] summary = NORMAL
2013-06-29 09:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51764  14 56472 32619553 A NORMALNORMAL'
2013-06-29 09:03:39 [DEBUG   ] Got command RPT from MCS: ref #51765
2013-06-29 09:03:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 09:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51765  48 56472 32619554 A NORMALSystem calibrated and operating normally'
2013-06-29 09:03:52 [DEBUG   ] Finished updating ant stats in 1.604 seconds
2013-06-29 09:03:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:03:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:03:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:03:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:03:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:03:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:03:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:03:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:03:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:03:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:03:59 [DEBUG   ] Finished updating board flags in 1.778 seconds
2013-06-29 09:04:11 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 09:04:31 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 09:04:51 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 09:04:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:04:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:04:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:04:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:04:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:04:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:04:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:04:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:04:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:04:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:04:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 09:04:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 09:04:59 [DEBUG   ] Finished updating board flags in 1.654 seconds
2013-06-29 09:05:11 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-29 09:05:31 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-29 09:05:51 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-29 09:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:05:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 09:05:59 [DEBUG   ] Finished updating board flags in 1.609 seconds
2013-06-29 09:06:11 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-29 09:06:32 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2013-06-29 09:06:52 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-29 09:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:06:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 09:06:59 [DEBUG   ] Finished updating board flags in 1.552 seconds
2013-06-29 09:07:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 09:07:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 09:07:52 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 09:07:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:07:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:07:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:07:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:07:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:07:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:07:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:07:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:07:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:07:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:07:59 [DEBUG   ] Finished updating board flags in 1.415 seconds
2013-06-29 09:08:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 09:08:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 09:08:39 [DEBUG   ] Got command RPT from MCS: ref #51781
2013-06-29 09:08:39 [DEBUG   ] summary = NORMAL
2013-06-29 09:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51781  14 56472 32919557 A NORMALNORMAL'
2013-06-29 09:08:39 [DEBUG   ] Got command RPT from MCS: ref #51782
2013-06-29 09:08:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 09:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51782  48 56472 32919558 A NORMALSystem calibrated and operating normally'
2013-06-29 09:08:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 09:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:08:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:08:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:08:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:08:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:08:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:08:59 [DEBUG   ] Finished updating board flags in 1.408 seconds
2013-06-29 09:09:12 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 09:09:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 09:09:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 09:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:09:59 [DEBUG   ] Finished updating board flags in 1.458 seconds
2013-06-29 09:10:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 09:10:32 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 09:10:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 09:10:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:10:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:10:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:10:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:10:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:10:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-29 09:11:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:11:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:11:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:11:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:11:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:11:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 09:11:00 [DEBUG   ] Finished updating board flags in 2.371 seconds
2013-06-29 09:11:12 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2013-06-29 09:11:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 09:11:52 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 09:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:12:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 09:12:00 [DEBUG   ] Finished updating board flags in 2.153 seconds
2013-06-29 09:12:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 09:12:32 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2013-06-29 09:12:53 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-29 09:12:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:12:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:12:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:12:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:12:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:13:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:13:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:13:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:13:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:13:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:13:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-29 09:13:00 [DEBUG   ] Finished updating board flags in 2.026 seconds
2013-06-29 09:13:13 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-29 09:13:33 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 09:13:39 [DEBUG   ] Got command RPT from MCS: ref #51798
2013-06-29 09:13:39 [DEBUG   ] summary = NORMAL
2013-06-29 09:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51798  14 56472 33219549 A NORMALNORMAL'
2013-06-29 09:13:39 [DEBUG   ] Got command RPT from MCS: ref #51799
2013-06-29 09:13:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 09:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51799  48 56472 33219550 A NORMALSystem calibrated and operating normally'
2013-06-29 09:13:53 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-29 09:13:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:13:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:13:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:13:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:13:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:14:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:14:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:14:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:14:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:14:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:14:00 [DEBUG   ] Finished updating board flags in 1.975 seconds
2013-06-29 09:14:13 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-29 09:14:33 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 09:14:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-29 09:14:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:14:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:14:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:14:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:14:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:15:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:15:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:15:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:15:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:15:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:15:00 [DEBUG   ] Finished updating board flags in 1.819 seconds
2013-06-29 09:15:13 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-29 09:15:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 09:15:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-29 09:15:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:15:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:15:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:15:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:15:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:16:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:16:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:16:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:16:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:16:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:16:00 [DEBUG   ] Finished updating board flags in 1.808 seconds
2013-06-29 09:16:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-29 09:16:33 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-29 09:16:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 09:16:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:16:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:16:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:16:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:16:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:17:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:17:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:17:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:17:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:17:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:17:00 [DEBUG   ] Finished updating board flags in 1.782 seconds
2013-06-29 09:17:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-29 09:17:33 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 09:17:53 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-29 09:17:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:17:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:17:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:17:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:17:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:18:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:18:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:18:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:18:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:18:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:18:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 09:18:00 [DEBUG   ] Finished updating board flags in 1.622 seconds
2013-06-29 09:18:13 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-29 09:18:33 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2013-06-29 09:18:39 [DEBUG   ] Got command RPT from MCS: ref #51815
2013-06-29 09:18:39 [DEBUG   ] summary = NORMAL
2013-06-29 09:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51815  14 56472 33519561 A NORMALNORMAL'
2013-06-29 09:18:39 [DEBUG   ] Got command RPT from MCS: ref #51816
2013-06-29 09:18:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 09:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51816  48 56472 33519562 A NORMALSystem calibrated and operating normally'
2013-06-29 09:18:54 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-29 09:18:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:18:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:18:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:18:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:18:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:19:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:19:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:19:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:19:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:19:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:19:00 [DEBUG   ] Finished updating board flags in 1.587 seconds
2013-06-29 09:19:14 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-29 09:19:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 09:19:54 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 09:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:20:00 [DEBUG   ] Finished updating board flags in 1.403 seconds
2013-06-29 09:20:14 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-29 09:20:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 09:20:54 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 09:20:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:20:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:20:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:20:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:20:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:21:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-29 09:21:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 09:21:00 [DEBUG   ] Finished updating board flags in 1.417 seconds
2013-06-29 09:21:14 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 09:21:34 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-29 09:21:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 09:21:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:21:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:21:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:21:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:21:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:22:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:22:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:22:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:22:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:22:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:22:00 [DEBUG   ] Finished updating board flags in 1.374 seconds
2013-06-29 09:22:14 [DEBUG   ] Finished updating ant stats in 0.592 seconds
2013-06-29 09:22:34 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-06-29 09:22:55 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-29 09:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:23:01 [DEBUG   ] Finished updating board flags in 2.230 seconds
2013-06-29 09:23:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 09:23:35 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-29 09:23:39 [DEBUG   ] Got command RPT from MCS: ref #51832
2013-06-29 09:23:39 [DEBUG   ] summary = NORMAL
2013-06-29 09:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51832  14 56472 33819557 A NORMALNORMAL'
2013-06-29 09:23:39 [DEBUG   ] Got command RPT from MCS: ref #51833
2013-06-29 09:23:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 09:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51833  48 56472 33819558 A NORMALSystem calibrated and operating normally'
2013-06-29 09:23:55 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 09:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:24:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-29 09:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:24:01 [DEBUG   ] Finished updating board flags in 2.187 seconds
2013-06-29 09:24:15 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2013-06-29 09:24:35 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2013-06-29 09:24:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 09:25:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:25:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:25:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:25:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:25:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:25:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:25:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:25:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:25:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:25:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:25:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-29 09:25:01 [DEBUG   ] Finished updating board flags in 2.005 seconds
2013-06-29 09:25:15 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 09:25:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 09:25:55 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 09:26:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:26:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:26:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:26:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:26:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:26:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:26:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:26:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:26:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:26:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:26:01 [DEBUG   ] Finished updating board flags in 2.008 seconds
2013-06-29 09:26:15 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-06-29 09:26:36 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-29 09:26:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 09:27:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:27:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:27:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:27:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:27:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:27:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:27:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:27:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:27:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:27:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:27:01 [DEBUG   ] Finished updating board flags in 1.987 seconds
2013-06-29 09:27:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 09:27:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 09:27:56 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 09:28:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:28:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:28:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:28:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:28:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:28:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:28:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:28:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:28:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:28:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:28:01 [DEBUG   ] Finished updating board flags in 1.850 seconds
2013-06-29 09:28:16 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-29 09:28:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 09:28:39 [DEBUG   ] Got command RPT from MCS: ref #51849
2013-06-29 09:28:39 [DEBUG   ] summary = NORMAL
2013-06-29 09:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51849  14 56472 34119561 A NORMALNORMAL'
2013-06-29 09:28:39 [DEBUG   ] Got command RPT from MCS: ref #51850
2013-06-29 09:28:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 09:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51850  48 56472 34119562 A NORMALSystem calibrated and operating normally'
2013-06-29 09:28:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 09:29:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:29:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:29:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:29:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:29:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:29:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:29:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:29:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:29:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:29:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:29:01 [DEBUG   ] Finished updating board flags in 1.759 seconds
2013-06-29 09:29:16 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 09:29:36 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 09:29:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 09:30:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:30:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:30:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:30:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:30:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:30:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:30:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:30:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:30:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:30:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:30:01 [DEBUG   ] Finished updating board flags in 1.611 seconds
2013-06-29 09:30:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 09:30:36 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 09:30:56 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-29 09:31:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:31:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:31:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:31:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:31:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:31:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:31:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:31:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:31:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:31:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:31:01 [DEBUG   ] Finished updating board flags in 1.596 seconds
2013-06-29 09:31:17 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-29 09:31:37 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-29 09:31:57 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 09:32:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:32:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:32:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:32:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:32:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:32:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:32:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:32:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:32:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:32:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:32:01 [DEBUG   ] Finished updating board flags in 1.418 seconds
2013-06-29 09:32:17 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-29 09:32:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 09:32:57 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 09:33:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:33:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:33:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:33:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:33:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:33:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:33:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:33:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:33:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:33:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:33:01 [DEBUG   ] Finished updating board flags in 1.396 seconds
2013-06-29 09:33:17 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 09:33:37 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-29 09:33:39 [DEBUG   ] Got command RPT from MCS: ref #51866
2013-06-29 09:33:39 [DEBUG   ] summary = NORMAL
2013-06-29 09:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51866  14 56472 34419561 A NORMALNORMAL'
2013-06-29 09:33:39 [DEBUG   ] Got command RPT from MCS: ref #51867
2013-06-29 09:33:39 [DEBUG   ] info = System calibrated and operating normally
2013-06-29 09:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51867  48 56472 34419562 A NORMALSystem calibrated and operating normally'
2013-06-29 09:33:57 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-29 09:34:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:34:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:34:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:34:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:34:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:34:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:34:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:34:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:34:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:34:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:34:02 [DEBUG   ] Finished updating board flags in 2.211 seconds
2013-06-29 09:34:17 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 09:34:37 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-29 09:34:58 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-29 09:35:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:35:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:35:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:35:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:35:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:35:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:35:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:35:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:35:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:35:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:35:02 [DEBUG   ] Finished updating board flags in 2.181 seconds
2013-06-29 09:35:18 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-29 09:35:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 09:35:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 09:36:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:36:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:36:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:36:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:36:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:36:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:36:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:36:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:36:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:36:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:36:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2013-06-29 09:36:02 [CRITICAL] MGT underflow detected on beam(s) 1
2013-06-29 09:36:02 [DEBUG   ] Finished updating board flags in 2.043 seconds
2013-06-29 09:36:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 09:36:38 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-29 09:36:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 09:37:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:37:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:37:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:37:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:37:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:37:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:37:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:37:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:37:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:37:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:37:02 [DEBUG   ] Finished updating board flags in 1.953 seconds
2013-06-29 09:37:18 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-29 09:37:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 09:37:58 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-29 09:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:38:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 09:38:02 [DEBUG   ] Finished updating board flags in 1.847 seconds
2013-06-29 09:38:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 09:38:38 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-29 09:38:39 [DEBUG   ] Got command RPT from MCS: ref #51883
2013-06-29 09:38:39 [DEBUG   ] summary = ERROR
2013-06-29 09:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51883  13 56472 34719561 A  ERRORERROR'
2013-06-29 09:38:39 [DEBUG   ] Got command RPT from MCS: ref #51884
2013-06-29 09:38:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-29 09:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51884  77 56472 34719562 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-29 09:38:58 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-29 09:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:39:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 09:39:02 [DEBUG   ] Finished updating board flags in 1.783 seconds
2013-06-29 09:39:19 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-29 09:39:39 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-29 09:39:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 09:40:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:40:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:40:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:40:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:40:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:40:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:40:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:40:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:40:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:40:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:40:02 [DEBUG   ] Finished updating board flags in 1.589 seconds
2013-06-29 09:40:19 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2013-06-29 09:40:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 09:40:59 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 09:41:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:41:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:41:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:41:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:41:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:41:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:41:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:41:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:41:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:41:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:41:02 [DEBUG   ] Finished updating board flags in 1.409 seconds
2013-06-29 09:41:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 09:41:39 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 09:41:59 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 09:42:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:42:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:42:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:42:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:42:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:42:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:42:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:42:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:42:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:42:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:42:02 [DEBUG   ] Finished updating board flags in 1.436 seconds
2013-06-29 09:42:19 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 09:42:39 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 09:42:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 09:43:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:43:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:43:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:43:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:43:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:43:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:43:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:43:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:43:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:43:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:43:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 09:43:03 [DEBUG   ] Finished updating board flags in 2.395 seconds
2013-06-29 09:43:19 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 09:43:39 [DEBUG   ] Got command RPT from MCS: ref #51900
2013-06-29 09:43:39 [DEBUG   ] summary = ERROR
2013-06-29 09:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51900  13 56472 35019569 A  ERRORERROR'
2013-06-29 09:43:39 [DEBUG   ] Got command RPT from MCS: ref #51901
2013-06-29 09:43:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-29 09:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51901  77 56472 35019570 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-29 09:43:40 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-29 09:44:00 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-29 09:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:44:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-29 09:44:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:44:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:44:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:44:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:44:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:44:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-29 09:44:03 [DEBUG   ] Finished updating board flags in 2.178 seconds
2013-06-29 09:44:20 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 09:44:40 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-29 09:45:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 09:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:45:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:45:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:45:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:45:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:45:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:45:03 [DEBUG   ] Finished updating board flags in 1.999 seconds
2013-06-29 09:45:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 09:45:40 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 09:46:00 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 09:46:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:46:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:46:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:46:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:46:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:46:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:46:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:46:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:46:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:46:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:46:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-29 09:46:03 [DEBUG   ] Finished updating board flags in 1.831 seconds
2013-06-29 09:46:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 09:46:40 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-29 09:47:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 09:47:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:47:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:47:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:47:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:47:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:47:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:47:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:47:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:47:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:47:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:47:03 [DEBUG   ] Finished updating board flags in 1.759 seconds
2013-06-29 09:47:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 09:47:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 09:48:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 09:48:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:48:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:48:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:48:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:48:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:48:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:48:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:48:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:48:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:48:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:48:03 [DEBUG   ] Finished updating board flags in 1.630 seconds
2013-06-29 09:48:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 09:48:39 [DEBUG   ] Got command RPT from MCS: ref #51917
2013-06-29 09:48:39 [DEBUG   ] summary = ERROR
2013-06-29 09:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51917  13 56472 35319562 A  ERRORERROR'
2013-06-29 09:48:39 [DEBUG   ] Got command RPT from MCS: ref #51918
2013-06-29 09:48:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-29 09:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51918  77 56472 35319562 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-29 09:48:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 09:49:00 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 09:49:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:49:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:49:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:49:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:49:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:49:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:49:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:49:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:49:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:49:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:49:03 [DEBUG   ] Finished updating board flags in 1.613 seconds
2013-06-29 09:49:20 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 09:49:40 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-29 09:50:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 09:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:50:03 [DEBUG   ] Finished updating board flags in 1.577 seconds
2013-06-29 09:50:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 09:50:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 09:51:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 09:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:51:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 09:51:03 [DEBUG   ] Finished updating board flags in 1.525 seconds
2013-06-29 09:51:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 09:51:40 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 09:52:00 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-29 09:52:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:52:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:52:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:52:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:52:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:52:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-29 09:52:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:52:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:52:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:52:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:52:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:52:04 [DEBUG   ] Finished updating board flags in 2.365 seconds
2013-06-29 09:52:20 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-29 09:52:40 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-29 09:53:01 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-29 09:53:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:53:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:53:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:53:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:53:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:53:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:53:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:53:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:53:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:53:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:53:04 [DEBUG   ] Finished updating board flags in 2.111 seconds
2013-06-29 09:53:21 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-29 09:53:39 [DEBUG   ] Got command RPT from MCS: ref #51934
2013-06-29 09:53:39 [DEBUG   ] summary = ERROR
2013-06-29 09:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51934  13 56472 35619561 A  ERRORERROR'
2013-06-29 09:53:39 [DEBUG   ] Got command RPT from MCS: ref #51935
2013-06-29 09:53:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-29 09:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51935  77 56472 35619562 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-29 09:53:41 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 09:54:01 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 09:54:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:54:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:54:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:54:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:54:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:54:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:54:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:54:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:54:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:54:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:54:04 [DEBUG   ] Finished updating board flags in 2.022 seconds
2013-06-29 09:54:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 09:54:41 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-29 09:55:01 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 09:55:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:55:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:55:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:55:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:55:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:55:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:55:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:55:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:55:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:55:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:55:04 [DEBUG   ] Finished updating board flags in 1.969 seconds
2013-06-29 09:55:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 09:55:41 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 09:56:01 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-29 09:56:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:56:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:56:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:56:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:56:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:56:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:56:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:56:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:56:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:56:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:56:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-29 09:56:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 09:56:04 [DEBUG   ] Finished updating board flags in 1.828 seconds
2013-06-29 09:56:21 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 09:56:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 09:57:01 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-29 09:57:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:57:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:57:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:57:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:57:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:57:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:57:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:57:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:57:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:57:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:57:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 09:57:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2013-06-29 09:57:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 09:57:04 [CRITICAL] MGT underflow detected on beam(s) 1
2013-06-29 09:57:04 [DEBUG   ] Finished updating board flags in 1.778 seconds
2013-06-29 09:57:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-29 09:57:41 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-29 09:58:01 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-29 09:58:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:58:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:58:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:58:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:58:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:58:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:58:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:58:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:58:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:58:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:58:04 [DEBUG   ] Finished updating board flags in 1.624 seconds
2013-06-29 09:58:22 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-29 09:58:39 [DEBUG   ] Got command RPT from MCS: ref #51951
2013-06-29 09:58:39 [DEBUG   ] summary = ERROR
2013-06-29 09:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51951  13 56472 35919565 A  ERRORERROR'
2013-06-29 09:58:39 [DEBUG   ] Got command RPT from MCS: ref #51952
2013-06-29 09:58:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-29 09:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51952  77 56472 35919566 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-29 09:58:42 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-29 09:59:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 09:59:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 09:59:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 09:59:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 09:59:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 09:59:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 09:59:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 09:59:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 09:59:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 09:59:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 09:59:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 09:59:04 [DEBUG   ] Finished updating board flags in 1.588 seconds
2013-06-29 09:59:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 09:59:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 10:00:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 10:00:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:00:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:00:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:00:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:00:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:00:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:00:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:00:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:00:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:00:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:00:04 [DEBUG   ] Finished updating board flags in 1.429 seconds
2013-06-29 10:00:22 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 10:00:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 10:01:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 10:01:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:01:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:01:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:01:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:01:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:01:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:01:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:01:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:01:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:01:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:01:04 [DEBUG   ] Finished updating board flags in 1.419 seconds
2013-06-29 10:01:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 10:01:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 10:02:02 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-29 10:02:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:02:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:02:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:02:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:02:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:02:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:02:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:02:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:02:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:02:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:02:04 [DEBUG   ] Finished updating board flags in 1.425 seconds
2013-06-29 10:02:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 10:02:42 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 10:03:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 10:03:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:03:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:03:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:03:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:03:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:03:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:03:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:03:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:03:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:03:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:03:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-29 10:03:05 [DEBUG   ] Finished updating board flags in 2.385 seconds
2013-06-29 10:03:22 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-29 10:03:39 [DEBUG   ] Got command RPT from MCS: ref #51968
2013-06-29 10:03:39 [DEBUG   ] summary = ERROR
2013-06-29 10:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51968  13 56472 36219573 A  ERRORERROR'
2013-06-29 10:03:39 [DEBUG   ] Got command RPT from MCS: ref #51969
2013-06-29 10:03:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-29 10:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51969  77 56472 36219574 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-29 10:03:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 10:04:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 10:04:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:04:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:04:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:04:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:04:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:04:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:04:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:04:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:04:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:04:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:04:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-29 10:04:05 [DEBUG   ] Finished updating board flags in 2.151 seconds
2013-06-29 10:04:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 10:04:42 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 10:05:03 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-29 10:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:05:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:05:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:05:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:05:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:05:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:05:05 [DEBUG   ] Finished updating board flags in 2.023 seconds
2013-06-29 10:05:23 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-29 10:05:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 10:06:03 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 10:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:06:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:06:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:06:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:06:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:06:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:06:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-29 10:06:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 10:06:05 [DEBUG   ] Finished updating board flags in 1.977 seconds
2013-06-29 10:06:23 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 10:06:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 10:07:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 10:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:07:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:07:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:07:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:07:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:07:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:07:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 10:07:05 [DEBUG   ] Finished updating board flags in 1.814 seconds
2013-06-29 10:07:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 10:07:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 10:08:03 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-29 10:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:08:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:08:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:08:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:08:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:08:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:08:05 [DEBUG   ] Finished updating board flags in 1.865 seconds
2013-06-29 10:08:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 10:08:39 [DEBUG   ] Got command RPT from MCS: ref #51985
2013-06-29 10:08:39 [DEBUG   ] summary = ERROR
2013-06-29 10:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51985  13 56472 36519577 A  ERRORERROR'
2013-06-29 10:08:39 [DEBUG   ] Got command RPT from MCS: ref #51986
2013-06-29 10:08:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-29 10:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    51986  77 56472 36519578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-29 10:08:43 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-29 10:09:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 10:09:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:09:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:09:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:09:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:09:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:09:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:09:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:09:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:09:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:09:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:09:05 [DEBUG   ] Finished updating board flags in 1.718 seconds
2013-06-29 10:09:23 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 10:09:43 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 10:10:03 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-29 10:10:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:10:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:10:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:10:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:10:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:10:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:10:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:10:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:10:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:10:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:10:05 [DEBUG   ] Finished updating board flags in 1.621 seconds
2013-06-29 10:10:24 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-29 10:10:44 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-29 10:11:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:11:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:11:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:11:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:11:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:11:04 [DEBUG   ] Finished updating ant stats in 1.251 seconds
2013-06-29 10:11:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:11:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:11:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:11:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:11:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:11:05 [DEBUG   ] Finished updating board flags in 1.607 seconds
2013-06-29 10:11:24 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2013-06-29 10:11:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 10:12:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:12:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:12:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:12:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:12:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:12:04 [DEBUG   ] Finished updating ant stats in 1.050 seconds
2013-06-29 10:12:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:12:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:12:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:12:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:12:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:12:05 [DEBUG   ] Finished updating board flags in 1.587 seconds
2013-06-29 10:12:24 [DEBUG   ] Finished updating ant stats in 0.956 seconds
2013-06-29 10:12:44 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 10:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:13:04 [DEBUG   ] Finished updating ant stats in 0.644 seconds
2013-06-29 10:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:13:05 [DEBUG   ] Finished updating board flags in 1.412 seconds
2013-06-29 10:13:24 [DEBUG   ] Finished updating ant stats in 0.555 seconds
2013-06-29 10:13:39 [DEBUG   ] Got command RPT from MCS: ref #52002
2013-06-29 10:13:39 [DEBUG   ] summary = ERROR
2013-06-29 10:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52002  13 56472 36819577 A  ERRORERROR'
2013-06-29 10:13:39 [DEBUG   ] Got command RPT from MCS: ref #52003
2013-06-29 10:13:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-29 10:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52003  77 56472 36819578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-29 10:13:44 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-29 10:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:14:05 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-29 10:14:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 10:14:05 [DEBUG   ] Finished updating board flags in 1.393 seconds
2013-06-29 10:14:25 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-29 10:14:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 10:15:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:15:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:15:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:15:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:15:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:15:05 [DEBUG   ] Finished updating ant stats in 1.251 seconds
2013-06-29 10:15:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:15:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:15:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:15:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:15:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 10:15:06 [DEBUG   ] Finished updating board flags in 2.214 seconds
2013-06-29 10:15:25 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2013-06-29 10:15:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 10:16:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:16:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:16:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:16:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:16:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:16:05 [DEBUG   ] Finished updating ant stats in 1.050 seconds
2013-06-29 10:16:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:16:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:16:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:16:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:16:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:16:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-29 10:16:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-29 10:16:06 [DEBUG   ] Finished updating board flags in 2.190 seconds
2013-06-29 10:16:25 [DEBUG   ] Finished updating ant stats in 0.956 seconds
2013-06-29 10:16:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 10:17:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:17:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:17:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:17:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:17:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:17:05 [DEBUG   ] Finished updating ant stats in 0.843 seconds
2013-06-29 10:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:17:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-29 10:17:06 [DEBUG   ] Finished updating board flags in 2.006 seconds
2013-06-29 10:17:25 [DEBUG   ] Finished updating ant stats in 0.759 seconds
2013-06-29 10:17:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 10:18:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:18:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:18:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:18:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:18:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:18:05 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2013-06-29 10:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:18:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-29 10:18:06 [DEBUG   ] Finished updating board flags in 2.014 seconds
2013-06-29 10:18:25 [DEBUG   ] Finished updating ant stats in 0.555 seconds
2013-06-29 10:18:39 [DEBUG   ] Got command RPT from MCS: ref #52019
2013-06-29 10:18:39 [DEBUG   ] summary = ERROR
2013-06-29 10:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52019  13 56472 37119569 A  ERRORERROR'
2013-06-29 10:18:39 [DEBUG   ] Got command RPT from MCS: ref #52020
2013-06-29 10:18:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-29 10:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52020  77 56472 37119570 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-29 10:18:45 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-29 10:19:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:19:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:19:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:19:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:19:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:19:05 [DEBUG   ] Finished updating ant stats in 0.450 seconds
2013-06-29 10:19:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:19:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:19:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:19:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:19:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:19:06 [DEBUG   ] Finished updating board flags in 1.980 seconds
2013-06-29 10:19:26 [DEBUG   ] Finished updating ant stats in 1.355 seconds
2013-06-29 10:19:46 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 10:20:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:20:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:20:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:20:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:20:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:20:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:20:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:20:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:20:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:20:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:20:06 [DEBUG   ] Finished updating ant stats in 1.243 seconds
2013-06-29 10:20:06 [DEBUG   ] Finished updating board flags in 1.869 seconds
2013-06-29 10:20:26 [DEBUG   ] Finished updating ant stats in 1.159 seconds
2013-06-29 10:20:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 10:21:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:21:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:21:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:21:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:21:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:21:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:21:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:21:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:21:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:21:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:21:06 [DEBUG   ] Finished updating ant stats in 1.047 seconds
2013-06-29 10:21:06 [DEBUG   ] Finished updating board flags in 1.799 seconds
2013-06-29 10:21:26 [DEBUG   ] Finished updating ant stats in 0.959 seconds
2013-06-29 10:21:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 10:22:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:22:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:22:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:22:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:22:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:22:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:22:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:22:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:22:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:22:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:22:06 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2013-06-29 10:22:06 [DEBUG   ] Finished updating board flags in 1.595 seconds
2013-06-29 10:22:26 [DEBUG   ] Finished updating ant stats in 0.760 seconds
2013-06-29 10:22:46 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 10:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:23:06 [DEBUG   ] Finished updating ant stats in 0.642 seconds
2013-06-29 10:23:06 [DEBUG   ] Finished updating board flags in 1.634 seconds
2013-06-29 10:23:26 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2013-06-29 10:23:39 [DEBUG   ] Got command RPT from MCS: ref #52036
2013-06-29 10:23:39 [DEBUG   ] summary = ERROR
2013-06-29 10:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52036  13 56472 37419573 A  ERRORERROR'
2013-06-29 10:23:39 [DEBUG   ] Got command RPT from MCS: ref #52037
2013-06-29 10:23:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-29 10:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52037  77 56472 37419574 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-29 10:23:46 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2013-06-29 10:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:24:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:24:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:24:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:24:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:24:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:24:07 [DEBUG   ] Finished updating ant stats in 1.245 seconds
2013-06-29 10:24:07 [DEBUG   ] Finished updating board flags in 2.385 seconds
2013-06-29 10:24:27 [DEBUG   ] Finished updating ant stats in 1.159 seconds
2013-06-29 10:24:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 10:25:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:25:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:25:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:25:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:25:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:25:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:25:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:25:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:25:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:25:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:25:07 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2013-06-29 10:25:07 [DEBUG   ] Finished updating board flags in 2.186 seconds
2013-06-29 10:25:27 [DEBUG   ] Finished updating ant stats in 0.960 seconds
2013-06-29 10:25:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 10:26:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:26:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:26:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:26:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:26:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:26:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:26:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:26:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:26:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:26:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:26:07 [DEBUG   ] Finished updating ant stats in 0.848 seconds
2013-06-29 10:26:07 [DEBUG   ] Finished updating board flags in 2.014 seconds
2013-06-29 10:26:27 [DEBUG   ] Finished updating ant stats in 0.759 seconds
2013-06-29 10:26:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 10:27:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:27:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:27:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:27:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:27:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:27:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:27:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:27:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:27:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:27:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:27:07 [DEBUG   ] Finished updating ant stats in 0.641 seconds
2013-06-29 10:27:07 [DEBUG   ] Finished updating board flags in 1.987 seconds
2013-06-29 10:27:27 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2013-06-29 10:27:47 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-29 10:28:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:28:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:28:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:28:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:28:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:28:07 [DEBUG   ] Finished updating ant stats in 0.446 seconds
2013-06-29 10:28:07 [DEBUG   ] Finished updating board flags in 1.826 seconds
2013-06-29 10:28:28 [DEBUG   ] Finished updating ant stats in 1.360 seconds
2013-06-29 10:28:39 [DEBUG   ] Got command RPT from MCS: ref #52053
2013-06-29 10:28:39 [DEBUG   ] summary = ERROR
2013-06-29 10:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52053  13 56472 37719581 A  ERRORERROR'
2013-06-29 10:28:39 [DEBUG   ] Got command RPT from MCS: ref #52054
2013-06-29 10:28:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-29 10:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52054  77 56472 37719582 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-29 10:28:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 10:29:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:29:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:29:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:29:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:29:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:29:07 [DEBUG   ] Finished updating board flags in 1.808 seconds
2013-06-29 10:29:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 10:29:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 10:29:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 10:30:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:30:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:30:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:30:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:30:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:30:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:30:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:30:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:30:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:30:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:30:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 10:30:08 [DEBUG   ] Finished updating board flags in 2.896 seconds
2013-06-29 10:30:28 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 10:30:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 10:31:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:31:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:31:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:31:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:31:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:31:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:31:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:31:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:31:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:31:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:31:07 [DEBUG   ] Finished updating board flags in 1.666 seconds
2013-06-29 10:31:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 10:31:28 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-29 10:31:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 10:32:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:32:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:32:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:32:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:32:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:32:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:32:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:32:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:32:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:32:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:32:07 [DEBUG   ] Finished updating board flags in 1.614 seconds
2013-06-29 10:32:08 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 10:32:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 10:32:48 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 10:33:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:33:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:33:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:33:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:33:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:33:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:33:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:33:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:33:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:33:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:33:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 10:33:07 [DEBUG   ] Finished updating board flags in 1.554 seconds
2013-06-29 10:33:08 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-29 10:33:29 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-29 10:33:39 [DEBUG   ] Got command RPT from MCS: ref #52070
2013-06-29 10:33:39 [DEBUG   ] summary = ERROR
2013-06-29 10:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52070  13 56472 38019577 A  ERRORERROR'
2013-06-29 10:33:39 [DEBUG   ] Got command RPT from MCS: ref #52071
2013-06-29 10:33:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-29 10:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52071  77 56472 38019578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-29 10:33:49 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-29 10:34:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:34:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:34:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:34:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:34:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:34:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:34:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:34:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:34:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:34:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:34:07 [DEBUG   ] Finished updating board flags in 1.418 seconds
2013-06-29 10:34:09 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-29 10:34:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 10:34:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 10:35:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:35:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:35:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:35:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:35:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:35:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:35:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:35:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:35:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:35:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:35:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 10:35:07 [DEBUG   ] Finished updating board flags in 1.385 seconds
2013-06-29 10:35:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 10:35:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 10:35:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 10:36:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:36:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:36:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:36:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:36:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:36:09 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-29 10:36:09 [DEBUG   ] Finished updating board flags in 3.359 seconds
2013-06-29 10:36:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 10:36:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 10:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:37:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:37:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:37:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:37:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:37:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:37:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-29 10:37:08 [DEBUG   ] Finished updating board flags in 2.093 seconds
2013-06-29 10:37:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 10:37:29 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 10:37:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 10:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:38:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:38:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:38:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:38:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:38:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:38:08 [DEBUG   ] Finished updating board flags in 2.082 seconds
2013-06-29 10:38:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 10:38:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 10:38:39 [DEBUG   ] Got command RPT from MCS: ref #52087
2013-06-29 10:38:39 [DEBUG   ] summary = ERROR
2013-06-29 10:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52087  13 56472 38319573 A  ERRORERROR'
2013-06-29 10:38:39 [DEBUG   ] Got command RPT from MCS: ref #52088
2013-06-29 10:38:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-29 10:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52088  77 56472 38319574 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-29 10:38:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 10:39:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:39:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:39:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:39:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:39:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:39:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:39:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:39:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:39:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:39:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:39:08 [DEBUG   ] Finished updating board flags in 1.929 seconds
2013-06-29 10:39:09 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-29 10:39:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 10:39:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 10:40:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:40:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:40:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:40:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:40:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:40:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:40:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:40:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:40:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:40:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:40:08 [DEBUG   ] Finished updating board flags in 1.814 seconds
2013-06-29 10:40:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 10:40:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 10:40:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 10:41:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:41:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:41:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:41:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:41:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:41:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:41:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:41:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:41:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:41:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:41:08 [DEBUG   ] Finished updating board flags in 1.734 seconds
2013-06-29 10:41:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 10:41:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 10:41:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 10:42:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:42:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:42:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:42:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:42:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:42:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:42:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:42:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:42:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:42:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:42:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 10:42:08 [DEBUG   ] Finished updating board flags in 1.626 seconds
2013-06-29 10:42:10 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-29 10:42:30 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-29 10:42:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 10:43:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:43:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:43:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:43:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:43:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:43:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:43:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:43:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:43:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:43:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:43:08 [DEBUG   ] Finished updating board flags in 1.581 seconds
2013-06-29 10:43:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-29 10:43:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 10:43:39 [DEBUG   ] Got command RPT from MCS: ref #52104
2013-06-29 10:43:39 [DEBUG   ] summary = ERROR
2013-06-29 10:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52104  13 56472 38619577 A  ERRORERROR'
2013-06-29 10:43:39 [DEBUG   ] Got command RPT from MCS: ref #52105
2013-06-29 10:43:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-29 10:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52105  77 56472 38619578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-29 10:43:50 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 10:44:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:44:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:44:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:44:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:44:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:44:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:44:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:44:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:44:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:44:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:44:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 10:44:08 [DEBUG   ] Finished updating board flags in 1.464 seconds
2013-06-29 10:44:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 10:44:30 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-29 10:44:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 10:45:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:45:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:45:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:45:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:45:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:45:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:45:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:45:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:45:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:45:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:45:10 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2013-06-29 10:45:10 [DEBUG   ] Finished updating board flags in 3.440 seconds
2013-06-29 10:45:30 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-29 10:45:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 10:46:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:46:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:46:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:46:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:46:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:46:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:46:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:46:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:46:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:46:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:46:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-29 10:46:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-29 10:46:09 [DEBUG   ] Finished updating board flags in 2.348 seconds
2013-06-29 10:46:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 10:46:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 10:46:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 10:47:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:47:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:47:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:47:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:47:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:47:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-29 10:47:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:47:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:47:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:47:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:47:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:47:09 [DEBUG   ] Finished updating board flags in 2.219 seconds
2013-06-29 10:47:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 10:47:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 10:47:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 10:48:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:48:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:48:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:48:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:48:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:48:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:48:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:48:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:48:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:48:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:48:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-29 10:48:09 [DEBUG   ] Finished updating board flags in 2.178 seconds
2013-06-29 10:48:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 10:48:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 10:48:39 [DEBUG   ] Got command RPT from MCS: ref #52121
2013-06-29 10:48:39 [DEBUG   ] summary = ERROR
2013-06-29 10:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52121  13 56472 38919585 A  ERRORERROR'
2013-06-29 10:48:39 [DEBUG   ] Got command RPT from MCS: ref #52122
2013-06-29 10:48:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-29 10:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52122  77 56472 38919586 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-29 10:48:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 10:49:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:49:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:49:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:49:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:49:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:49:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:49:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:49:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:49:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:49:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:49:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 10:49:09 [DEBUG   ] Finished updating board flags in 2.061 seconds
2013-06-29 10:49:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 10:49:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 10:49:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 10:50:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:50:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:50:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:50:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:50:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:50:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:50:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:50:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:50:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:50:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:50:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 10:50:09 [DEBUG   ] Finished updating board flags in 2.024 seconds
2013-06-29 10:50:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 10:50:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 10:50:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 10:51:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:51:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:51:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:51:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:51:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:51:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:51:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:51:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:51:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:51:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:51:09 [DEBUG   ] Finished updating board flags in 2.008 seconds
2013-06-29 10:51:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 10:51:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 10:51:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 10:52:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:52:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:52:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:52:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:52:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:52:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:52:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:52:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:52:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:52:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:52:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 10:52:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 10:52:09 [DEBUG   ] Finished updating board flags in 2.018 seconds
2013-06-29 10:52:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 10:52:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 10:52:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 10:53:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:53:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:53:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:53:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:53:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:53:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:53:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:53:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:53:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:53:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:53:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 10:53:09 [DEBUG   ] Finished updating board flags in 1.898 seconds
2013-06-29 10:53:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 10:53:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 10:53:39 [DEBUG   ] Got command RPT from MCS: ref #52138
2013-06-29 10:53:39 [DEBUG   ] summary = ERROR
2013-06-29 10:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52138  13 56472 39219577 A  ERRORERROR'
2013-06-29 10:53:39 [DEBUG   ] Got command RPT from MCS: ref #52139
2013-06-29 10:53:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-29 10:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52139  77 56472 39219578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-29 10:53:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 10:54:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:54:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:54:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:54:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:54:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:54:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:54:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:54:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:54:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:54:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:54:09 [DEBUG   ] Finished updating board flags in 1.807 seconds
2013-06-29 10:54:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 10:54:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 10:54:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 10:55:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:55:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:55:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:55:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:55:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:55:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:55:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:55:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:55:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:55:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:55:09 [DEBUG   ] Finished updating board flags in 1.779 seconds
2013-06-29 10:55:10 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-29 10:55:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 10:55:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 10:56:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:56:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:56:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:56:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:56:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:56:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:56:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:56:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:56:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:56:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:56:09 [DEBUG   ] Finished updating board flags in 1.600 seconds
2013-06-29 10:56:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 10:56:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 10:56:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 10:57:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:57:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:57:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:57:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:57:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:57:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:57:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:57:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:57:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:57:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:57:09 [DEBUG   ] Finished updating board flags in 1.461 seconds
2013-06-29 10:57:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 10:57:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 10:57:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 10:58:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:58:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:58:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:58:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:58:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:58:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-29 10:58:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:58:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:58:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:58:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:58:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:58:10 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2013-06-29 10:58:10 [DEBUG   ] Finished updating board flags in 2.394 seconds
2013-06-29 10:58:30 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2013-06-29 10:58:39 [DEBUG   ] Got command RPT from MCS: ref #52155
2013-06-29 10:58:39 [DEBUG   ] summary = ERROR
2013-06-29 10:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52155  13 56472 39519577 A  ERRORERROR'
2013-06-29 10:58:39 [DEBUG   ] Got command RPT from MCS: ref #52156
2013-06-29 10:58:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-29 10:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52156  77 56472 39519578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-29 10:58:50 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-29 10:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 10:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 10:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 10:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 10:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 10:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 10:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 10:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 10:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 10:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 10:59:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 10:59:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 10:59:10 [DEBUG   ] Finished updating board flags in 2.188 seconds
2013-06-29 10:59:11 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-29 10:59:31 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-29 10:59:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:00:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-29 11:00:10 [DEBUG   ] Finished updating board flags in 2.030 seconds
2013-06-29 11:00:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:00:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 11:00:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:01:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:01:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:01:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:01:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:01:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:01:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:01:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:01:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:01:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:01:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:01:10 [DEBUG   ] Finished updating board flags in 2.034 seconds
2013-06-29 11:01:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:01:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:01:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 11:02:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:02:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:02:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:02:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:02:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:02:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:02:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:02:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:02:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:02:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:02:10 [DEBUG   ] Finished updating board flags in 1.930 seconds
2013-06-29 11:02:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-29 11:02:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:02:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:03:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:03:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:03:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:03:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:03:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:03:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:03:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:03:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:03:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:03:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:03:10 [DEBUG   ] Finished updating board flags in 1.848 seconds
2013-06-29 11:03:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:03:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:03:39 [DEBUG   ] Got command RPT from MCS: ref #52172
2013-06-29 11:03:39 [DEBUG   ] summary = ERROR
2013-06-29 11:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52172  13 56472 39819585 A  ERRORERROR'
2013-06-29 11:03:39 [DEBUG   ] Got command RPT from MCS: ref #52173
2013-06-29 11:03:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-29 11:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52173  77 56472 39819586 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-29 11:03:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 11:04:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:04:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:04:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:04:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:04:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:04:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:04:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:04:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:04:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:04:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:04:10 [DEBUG   ] Finished updating board flags in 1.755 seconds
2013-06-29 11:04:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:04:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 11:04:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-29 11:05:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:05:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:05:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:05:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:05:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:05:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:05:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:05:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:05:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:05:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:05:10 [DEBUG   ] Finished updating board flags in 1.625 seconds
2013-06-29 11:05:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:05:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:05:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 11:06:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:06:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:06:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:06:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:06:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:06:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:06:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:06:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:06:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:06:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:06:10 [DEBUG   ] Finished updating board flags in 1.628 seconds
2013-06-29 11:06:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:06:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:06:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:07:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:07:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:07:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:07:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:07:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:07:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-29 11:07:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:07:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:07:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:07:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:07:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:07:10 [DEBUG   ] Finished updating board flags in 1.632 seconds
2013-06-29 11:07:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 11:07:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-29 11:07:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:08:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:08:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:08:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:08:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:08:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:08:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:08:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:08:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:08:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:08:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:08:10 [DEBUG   ] Finished updating board flags in 1.617 seconds
2013-06-29 11:08:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:08:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:08:39 [DEBUG   ] Got command RPT from MCS: ref #52189
2013-06-29 11:08:39 [DEBUG   ] summary = ERROR
2013-06-29 11:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52189  13 56472 40119581 A  ERRORERROR'
2013-06-29 11:08:39 [DEBUG   ] Got command RPT from MCS: ref #52190
2013-06-29 11:08:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-29 11:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52190  77 56472 40119582 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-29 11:08:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:09:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:09:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:09:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:09:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:09:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:09:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:09:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:09:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:09:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:09:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:09:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 11:09:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:09:11 [DEBUG   ] Finished updating board flags in 2.743 seconds
2013-06-29 11:09:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:09:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 11:10:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:10:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:10:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:10:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:10:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:10:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:10:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:10:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:10:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:10:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:10:11 [DEBUG   ] Finished updating ant stats in 1.245 seconds
2013-06-29 11:10:11 [DEBUG   ] Finished updating board flags in 2.356 seconds
2013-06-29 11:10:31 [DEBUG   ] Finished updating ant stats in 1.159 seconds
2013-06-29 11:10:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 11:11:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:11:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:11:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:11:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:11:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:11:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:11:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:11:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:11:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:11:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:11:11 [DEBUG   ] Finished updating ant stats in 1.047 seconds
2013-06-29 11:11:11 [DEBUG   ] Finished updating board flags in 2.229 seconds
2013-06-29 11:11:31 [DEBUG   ] Finished updating ant stats in 0.958 seconds
2013-06-29 11:11:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 11:12:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:12:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:12:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:12:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:12:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:12:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:12:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:12:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:12:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:12:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:12:11 [DEBUG   ] Finished updating ant stats in 0.844 seconds
2013-06-29 11:12:11 [DEBUG   ] Finished updating board flags in 2.180 seconds
2013-06-29 11:12:31 [DEBUG   ] Finished updating ant stats in 0.759 seconds
2013-06-29 11:12:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 11:13:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:13:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:13:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:13:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:13:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:13:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:13:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:13:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:13:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:13:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:13:11 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2013-06-29 11:13:11 [DEBUG   ] Finished updating board flags in 2.027 seconds
2013-06-29 11:13:31 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2013-06-29 11:13:39 [DEBUG   ] Got command RPT from MCS: ref #52206
2013-06-29 11:13:39 [DEBUG   ] summary = ERROR
2013-06-29 11:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52206  13 56472 40419585 A  ERRORERROR'
2013-06-29 11:13:39 [DEBUG   ] Got command RPT from MCS: ref #52207
2013-06-29 11:13:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-29 11:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52207  77 56472 40419586 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-29 11:13:52 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-29 11:14:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:14:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:14:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:14:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:14:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:14:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:14:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:14:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:14:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:14:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:14:11 [DEBUG   ] Finished updating board flags in 1.974 seconds
2013-06-29 11:14:12 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-29 11:14:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-29 11:14:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 11:15:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:15:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:15:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:15:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:15:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:15:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:15:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:15:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:15:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:15:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:15:11 [DEBUG   ] Finished updating board flags in 1.848 seconds
2013-06-29 11:15:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:15:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:15:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 11:16:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:16:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:16:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:16:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:16:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:16:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:16:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:16:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:16:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:16:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:16:11 [DEBUG   ] Finished updating board flags in 1.761 seconds
2013-06-29 11:16:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:16:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:16:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:17:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:17:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:17:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:17:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:17:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:17:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:17:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:17:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:17:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:17:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:17:11 [DEBUG   ] Finished updating board flags in 1.771 seconds
2013-06-29 11:17:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-29 11:17:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:17:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 11:18:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:18:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:18:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:18:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:18:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:18:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:18:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:18:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:18:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:18:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:18:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 11:18:11 [DEBUG   ] Finished updating board flags in 1.436 seconds
2013-06-29 11:18:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-29 11:18:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-29 11:18:39 [DEBUG   ] Got command RPT from MCS: ref #52223
2013-06-29 11:18:39 [DEBUG   ] summary = ERROR
2013-06-29 11:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52223  13 56472 40719585 A  ERRORERROR'
2013-06-29 11:18:39 [DEBUG   ] Got command RPT from MCS: ref #52224
2013-06-29 11:18:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-29 11:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52224  77 56472 40719586 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-29 11:18:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 11:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:19:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:19:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:19:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:19:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:19:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:19:12 [DEBUG   ] Finished updating ant stats in 1.248 seconds
2013-06-29 11:19:12 [DEBUG   ] Finished updating board flags in 2.529 seconds
2013-06-29 11:19:32 [DEBUG   ] Finished updating ant stats in 1.151 seconds
2013-06-29 11:19:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 11:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:20:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:20:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:20:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:20:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:20:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:20:12 [DEBUG   ] Finished updating ant stats in 1.052 seconds
2013-06-29 11:20:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 11:20:12 [DEBUG   ] Finished updating board flags in 2.310 seconds
2013-06-29 11:20:32 [DEBUG   ] Finished updating ant stats in 0.951 seconds
2013-06-29 11:20:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 11:21:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:21:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:21:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:21:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:21:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:21:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:21:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:21:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:21:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:21:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:21:12 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2013-06-29 11:21:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 11:21:12 [DEBUG   ] Finished updating board flags in 2.181 seconds
2013-06-29 11:21:32 [DEBUG   ] Finished updating ant stats in 0.759 seconds
2013-06-29 11:21:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 11:22:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:22:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:22:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:22:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:22:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:22:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:22:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:22:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:22:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:22:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:22:12 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2013-06-29 11:22:12 [DEBUG   ] Finished updating board flags in 2.007 seconds
2013-06-29 11:22:32 [DEBUG   ] Finished updating ant stats in 0.560 seconds
2013-06-29 11:22:53 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-29 11:23:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:23:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:23:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:23:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:23:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:23:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:23:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:23:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:23:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:23:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:23:13 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-29 11:23:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-29 11:23:13 [DEBUG   ] Finished updating board flags in 3.078 seconds
2013-06-29 11:23:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-29 11:23:39 [DEBUG   ] Got command RPT from MCS: ref #52240
2013-06-29 11:23:39 [DEBUG   ] summary = ERROR
2013-06-29 11:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52240  13 56472 41019593 A  ERRORERROR'
2013-06-29 11:23:39 [DEBUG   ] Got command RPT from MCS: ref #52241
2013-06-29 11:23:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-29 11:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52241  77 56472 41019594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-29 11:23:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 11:24:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:24:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:24:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:24:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:24:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:24:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-29 11:24:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:24:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:24:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:24:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:24:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:24:12 [DEBUG   ] Finished updating board flags in 1.883 seconds
2013-06-29 11:24:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:24:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-29 11:24:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-29 11:25:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:25:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:25:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:25:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:25:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:25:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:25:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:25:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:25:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:25:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:25:12 [DEBUG   ] Finished updating board flags in 1.820 seconds
2013-06-29 11:25:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 11:25:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 11:25:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-29 11:26:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:26:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:26:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:26:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:26:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:26:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:26:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:26:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:26:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:26:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:26:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 11:26:12 [DEBUG   ] Finished updating board flags in 1.827 seconds
2013-06-29 11:26:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-29 11:26:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 11:26:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 11:27:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:27:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:27:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:27:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:27:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:27:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:27:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:27:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:27:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:27:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:27:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 11:27:12 [DEBUG   ] Finished updating board flags in 1.801 seconds
2013-06-29 11:27:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-29 11:27:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:27:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 11:28:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:28:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:28:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:28:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:28:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:28:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:28:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:28:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:28:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:28:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:28:12 [DEBUG   ] Finished updating board flags in 1.828 seconds
2013-06-29 11:28:13 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 11:28:33 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-29 11:28:39 [DEBUG   ] Got command RPT from MCS: ref #52257
2013-06-29 11:28:39 [DEBUG   ] summary = ERROR
2013-06-29 11:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52257  13 56472 41319593 A  ERRORERROR'
2013-06-29 11:28:39 [DEBUG   ] Got command RPT from MCS: ref #52258
2013-06-29 11:28:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-29 11:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52258  77 56472 41319594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-29 11:28:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 11:29:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:29:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:29:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:29:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:29:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:29:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:29:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:29:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:29:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:29:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:29:12 [DEBUG   ] Finished updating board flags in 1.775 seconds
2013-06-29 11:29:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 11:29:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 11:29:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 11:30:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:30:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:30:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:30:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:30:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:30:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:30:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:30:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:30:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:30:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:30:12 [DEBUG   ] Finished updating board flags in 1.584 seconds
2013-06-29 11:30:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-29 11:30:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 11:30:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 11:31:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:31:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:31:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:31:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:31:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:31:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:31:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:31:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:31:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:31:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:31:13 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2013-06-29 11:31:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 11:31:13 [DEBUG   ] Finished updating board flags in 2.418 seconds
2013-06-29 11:31:33 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2013-06-29 11:31:53 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2013-06-29 11:32:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:32:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:32:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:32:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:32:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:32:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:32:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:32:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:32:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:32:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:32:13 [DEBUG   ] Finished updating board flags in 2.388 seconds
2013-06-29 11:32:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-29 11:32:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:32:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:33:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:33:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:33:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:33:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:33:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:33:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:33:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:33:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:33:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:33:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:33:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 11:33:13 [DEBUG   ] Finished updating board flags in 2.233 seconds
2013-06-29 11:33:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:33:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-29 11:33:39 [DEBUG   ] Got command RPT from MCS: ref #52274
2013-06-29 11:33:39 [DEBUG   ] summary = ERROR
2013-06-29 11:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52274  13 56472 41619593 A  ERRORERROR'
2013-06-29 11:33:39 [DEBUG   ] Got command RPT from MCS: ref #52275
2013-06-29 11:33:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-29 11:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52275  77 56472 41619594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-29 11:33:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:34:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:34:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:34:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:34:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:34:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:34:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:34:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:34:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:34:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:34:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:34:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 11:34:13 [DEBUG   ] Finished updating board flags in 2.226 seconds
2013-06-29 11:34:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 11:34:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:34:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:35:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:35:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:35:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:35:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:35:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:35:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-29 11:35:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:35:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:35:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:35:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:35:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:35:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-29 11:35:13 [DEBUG   ] Finished updating board flags in 2.144 seconds
2013-06-29 11:35:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:35:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:35:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:36:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:36:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:36:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:36:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:36:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:36:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:36:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:36:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:36:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:36:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:36:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 11:36:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 11:36:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 11:36:14 [DEBUG   ] Finished updating board flags in 3.142 seconds
2013-06-29 11:36:34 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-29 11:36:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 11:37:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:37:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:37:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:37:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:37:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:37:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:37:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:37:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:37:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:37:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:37:13 [DEBUG   ] Finished updating board flags in 1.841 seconds
2013-06-29 11:37:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 11:37:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 11:37:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 11:38:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:38:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:38:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:38:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:38:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:38:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:38:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:38:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:38:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:38:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:38:13 [DEBUG   ] Finished updating board flags in 1.853 seconds
2013-06-29 11:38:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 11:38:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 11:38:39 [DEBUG   ] Got command RPT from MCS: ref #52291
2013-06-29 11:38:39 [DEBUG   ] summary = ERROR
2013-06-29 11:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52291  13 56472 41919597 A  ERRORERROR'
2013-06-29 11:38:39 [DEBUG   ] Got command RPT from MCS: ref #52292
2013-06-29 11:38:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-29 11:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52292  77 56472 41919598 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-29 11:38:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 11:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:39:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:39:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:39:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:39:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:39:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:39:13 [DEBUG   ] Finished updating board flags in 1.771 seconds
2013-06-29 11:39:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 11:39:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 11:39:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 11:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:40:13 [DEBUG   ] Finished updating board flags in 1.637 seconds
2013-06-29 11:40:14 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-29 11:40:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 11:40:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 11:41:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:41:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:41:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:41:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:41:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:41:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:41:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:41:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:41:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:41:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:41:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 11:41:13 [DEBUG   ] Finished updating board flags in 1.553 seconds
2013-06-29 11:41:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 11:41:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 11:41:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 11:42:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:42:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:42:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:42:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:42:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:42:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:42:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:42:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:42:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:42:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:42:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 11:42:13 [DEBUG   ] Finished updating board flags in 1.497 seconds
2013-06-29 11:42:14 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2013-06-29 11:42:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 11:42:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 11:43:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:43:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:43:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:43:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:43:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:43:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:43:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:43:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:43:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:43:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:43:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 11:43:14 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2013-06-29 11:43:14 [DEBUG   ] Finished updating board flags in 2.329 seconds
2013-06-29 11:43:34 [DEBUG   ] Finished updating ant stats in 0.556 seconds
2013-06-29 11:43:39 [DEBUG   ] Got command RPT from MCS: ref #52308
2013-06-29 11:43:39 [DEBUG   ] summary = ERROR
2013-06-29 11:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52308  13 56472 42219593 A  ERRORERROR'
2013-06-29 11:43:39 [DEBUG   ] Got command RPT from MCS: ref #52309
2013-06-29 11:43:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-29 11:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52309  77 56472 42219594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-29 11:43:54 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-29 11:44:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:44:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:44:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:44:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:44:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:44:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:44:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:44:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:44:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:44:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:44:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 11:44:14 [DEBUG   ] Finished updating board flags in 2.174 seconds
2013-06-29 11:44:15 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-29 11:44:35 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-29 11:44:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 11:45:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:45:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:45:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:45:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:45:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:45:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:45:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:45:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:45:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:45:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:45:14 [DEBUG   ] Finished updating board flags in 2.056 seconds
2013-06-29 11:45:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 11:45:35 [DEBUG   ] Finished updating ant stats in 1.016 seconds
2013-06-29 11:45:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 11:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:46:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:46:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:46:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:46:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:46:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:46:14 [DEBUG   ] Finished updating board flags in 1.831 seconds
2013-06-29 11:46:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 11:46:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 11:46:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 11:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:47:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:47:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:47:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:47:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:47:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:47:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 11:47:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 11:47:14 [DEBUG   ] Finished updating board flags in 1.778 seconds
2013-06-29 11:47:15 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-29 11:47:35 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-29 11:47:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 11:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:48:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:48:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:48:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:48:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:48:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:48:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 11:48:14 [DEBUG   ] Finished updating board flags in 1.567 seconds
2013-06-29 11:48:15 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 11:48:36 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-29 11:48:39 [DEBUG   ] Got command RPT from MCS: ref #52325
2013-06-29 11:48:39 [DEBUG   ] summary = ERROR
2013-06-29 11:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52325  13 56472 42519593 A  ERRORERROR'
2013-06-29 11:48:39 [DEBUG   ] Got command RPT from MCS: ref #52326
2013-06-29 11:48:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-29 11:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52326  77 56472 42519594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-29 11:48:56 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-29 11:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:49:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 11:49:14 [DEBUG   ] Finished updating board flags in 1.421 seconds
2013-06-29 11:49:16 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 11:49:36 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-29 11:49:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 11:50:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:50:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:50:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:50:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:50:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:50:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:50:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:50:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:50:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:50:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:50:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 11:50:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 11:50:14 [DEBUG   ] Finished updating board flags in 1.413 seconds
2013-06-29 11:50:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 11:50:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 11:50:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 11:51:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:51:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:51:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:51:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:51:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:51:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:51:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:51:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:51:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:51:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:51:15 [DEBUG   ] Finished updating board flags in 2.456 seconds
2013-06-29 11:51:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 11:51:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 11:51:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 11:52:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:52:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:52:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:52:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:52:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:52:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:52:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:52:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:52:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:52:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:52:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 11:52:15 [DEBUG   ] Finished updating board flags in 2.359 seconds
2013-06-29 11:52:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-29 11:52:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 11:52:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 11:53:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:53:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:53:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:53:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:53:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:53:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:53:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:53:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:53:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:53:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:53:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 11:53:15 [DEBUG   ] Finished updating board flags in 2.186 seconds
2013-06-29 11:53:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 11:53:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 11:53:39 [DEBUG   ] Got command RPT from MCS: ref #52342
2013-06-29 11:53:39 [DEBUG   ] summary = ERROR
2013-06-29 11:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52342  13 56472 42819601 A  ERRORERROR'
2013-06-29 11:53:39 [DEBUG   ] Got command RPT from MCS: ref #52343
2013-06-29 11:53:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-29 11:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52343  77 56472 42819602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-29 11:53:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 11:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:54:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:54:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:54:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:54:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:54:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:54:15 [DEBUG   ] Finished updating board flags in 2.023 seconds
2013-06-29 11:54:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 11:54:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 11:54:56 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-29 11:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:55:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:55:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:55:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:55:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:55:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:55:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-29 11:55:15 [DEBUG   ] Finished updating board flags in 1.957 seconds
2013-06-29 11:55:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 11:55:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 11:55:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 11:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:56:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:56:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:56:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:56:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:56:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:56:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 11:56:15 [DEBUG   ] Finished updating board flags in 1.788 seconds
2013-06-29 11:56:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 11:56:37 [DEBUG   ] Finished updating ant stats in 1.602 seconds
2013-06-29 11:56:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 11:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:57:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:57:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:57:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:57:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:57:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:57:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-29 11:57:15 [DEBUG   ] Finished updating board flags in 1.684 seconds
2013-06-29 11:57:16 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 11:57:37 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-29 11:57:57 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-29 11:58:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:58:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:58:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:58:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:58:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:58:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:58:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:58:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:58:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:58:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:58:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 11:58:15 [DEBUG   ] Finished updating board flags in 1.509 seconds
2013-06-29 11:58:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 11:58:37 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-29 11:58:39 [DEBUG   ] Got command RPT from MCS: ref #52359
2013-06-29 11:58:39 [DEBUG   ] summary = ERROR
2013-06-29 11:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52359  13 56472 43119593 A  ERRORERROR'
2013-06-29 11:58:39 [DEBUG   ] Got command RPT from MCS: ref #52360
2013-06-29 11:58:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-29 11:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52360  77 56472 43119594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-29 11:58:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 11:59:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 11:59:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 11:59:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 11:59:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 11:59:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 11:59:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 11:59:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 11:59:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 11:59:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 11:59:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 11:59:15 [DEBUG   ] Finished updating board flags in 1.431 seconds
2013-06-29 11:59:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 11:59:37 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 11:59:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 12:00:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 12:00:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 12:00:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 12:00:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 12:00:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 12:00:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 12:00:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 12:00:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 12:00:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 12:00:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 12:00:15 [DEBUG   ] Finished updating board flags in 1.430 seconds
2013-06-29 12:00:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 12:00:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 12:00:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 12:01:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 12:01:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 12:01:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 12:01:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 12:01:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 12:01:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 12:01:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 12:01:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 12:01:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 12:01:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 12:01:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 12:01:16 [DEBUG   ] Finished updating board flags in 2.417 seconds
2013-06-29 12:01:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 12:01:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-29 12:01:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 12:02:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 12:02:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 12:02:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 12:02:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 12:02:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 12:02:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 12:02:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 12:02:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 12:02:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 12:02:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 12:02:16 [DEBUG   ] Finished updating board flags in 2.429 seconds
2013-06-29 12:02:17 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 12:02:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 12:02:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 12:03:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 12:03:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 12:03:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 12:03:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 12:03:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 12:03:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 12:03:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 12:03:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 12:03:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 12:03:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 12:03:16 [DEBUG   ] Finished updating board flags in 2.304 seconds
2013-06-29 12:03:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 12:03:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 12:03:39 [DEBUG   ] Got command RPT from MCS: ref #52376
2013-06-29 12:03:39 [DEBUG   ] summary = ERROR
2013-06-29 12:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52376  13 56472 43419601 A  ERRORERROR'
2013-06-29 12:03:39 [DEBUG   ] Got command RPT from MCS: ref #52377
2013-06-29 12:03:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-29 12:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52377  77 56472 43419602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-29 12:03:57 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 12:04:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 12:04:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 12:04:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 12:04:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 12:04:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 12:04:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 12:04:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 12:04:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 12:04:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 12:04:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 12:04:16 [DEBUG   ] Finished updating board flags in 2.208 seconds
2013-06-29 12:04:18 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-29 12:04:38 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-29 12:04:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 12:05:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 12:05:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 12:05:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 12:05:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 12:05:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 12:05:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 12:05:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 12:05:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 12:05:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 12:05:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 12:05:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-29 12:05:16 [DEBUG   ] Finished updating board flags in 2.207 seconds
2013-06-29 12:05:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-29 12:05:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 12:05:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 12:06:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 12:06:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 12:06:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 12:06:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 12:06:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 12:06:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 12:06:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 12:06:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 12:06:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 12:06:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 12:06:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 12:06:16 [DEBUG   ] Finished updating board flags in 2.255 seconds
2013-06-29 12:06:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-29 12:06:38 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-29 12:06:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 12:07:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 12:07:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 12:07:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 12:07:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 12:07:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 12:07:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 12:07:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 12:07:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 12:07:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 12:07:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 12:07:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-29 12:07:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-29 12:07:16 [DEBUG   ] Finished updating board flags in 2.125 seconds
2013-06-29 12:07:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 12:07:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 12:07:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 12:08:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 12:08:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 12:08:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 12:08:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 12:08:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 12:08:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 12:08:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 12:08:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 12:08:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 12:08:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 12:08:16 [DEBUG   ] Finished updating board flags in 2.020 seconds
2013-06-29 12:08:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 12:08:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 12:08:39 [DEBUG   ] Got command RPT from MCS: ref #52393
2013-06-29 12:08:39 [DEBUG   ] summary = ERROR
2013-06-29 12:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52393  13 56472 43719601 A  ERRORERROR'
2013-06-29 12:08:39 [DEBUG   ] Got command RPT from MCS: ref #52394
2013-06-29 12:08:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-29 12:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52394  77 56472 43719602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-29 12:08:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 12:09:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 12:09:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 12:09:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 12:09:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 12:09:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 12:09:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 12:09:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 12:09:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 12:09:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 12:09:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 12:09:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-29 12:09:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-29 12:09:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 12:09:16 [DEBUG   ] Finished updating board flags in 2.011 seconds
2013-06-29 12:09:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-29 12:09:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-29 12:09:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 12:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 12:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 12:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 12:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 12:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 12:10:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 12:10:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 12:10:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 12:10:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 12:10:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 12:10:16 [DEBUG   ] Finished updating board flags in 2.029 seconds
2013-06-29 12:10:18 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-29 12:10:38 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-29 12:10:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 12:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 12:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 12:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 12:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 12:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 12:11:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 12:11:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 12:11:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 12:11:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 12:11:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 12:11:16 [DEBUG   ] Finished updating board flags in 2.018 seconds
2013-06-29 12:11:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 12:11:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 12:11:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 12:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 12:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 12:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 12:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 12:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 12:12:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 12:12:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 12:12:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 12:12:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 12:12:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 12:12:16 [DEBUG   ] Finished updating board flags in 2.059 seconds
2013-06-29 12:12:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 12:12:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 12:12:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 12:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 12:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 12:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 12:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 12:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 12:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 12:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 12:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 12:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 12:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 12:13:16 [DEBUG   ] Finished updating board flags in 1.883 seconds
2013-06-29 12:13:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 12:13:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 12:13:39 [DEBUG   ] Got command RPT from MCS: ref #52410
2013-06-29 12:13:39 [DEBUG   ] summary = ERROR
2013-06-29 12:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52410  13 56472 44019601 A  ERRORERROR'
2013-06-29 12:13:39 [DEBUG   ] Got command RPT from MCS: ref #52411
2013-06-29 12:13:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-29 12:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52411  77 56472 44019602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-29 12:13:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 12:14:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 12:14:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 12:14:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 12:14:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 12:14:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 12:14:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 12:14:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 12:14:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 12:14:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 12:14:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 12:14:16 [DEBUG   ] Finished updating board flags in 1.814 seconds
2013-06-29 12:14:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 12:14:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 12:14:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 12:15:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 12:15:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 12:15:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 12:15:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 12:15:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 12:15:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 12:15:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 12:15:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 12:15:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 12:15:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 12:15:16 [DEBUG   ] Finished updating board flags in 1.807 seconds
2013-06-29 12:15:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 12:15:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 12:15:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-29 12:16:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 12:16:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 12:16:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 12:16:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 12:16:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 12:16:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 12:16:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 12:16:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 12:16:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 12:16:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 12:16:16 [DEBUG   ] Finished updating board flags in 1.782 seconds
2013-06-29 12:16:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 12:16:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 12:16:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 12:17:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 12:17:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 12:17:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 12:17:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 12:17:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 12:17:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 12:17:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 12:17:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 12:17:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 12:17:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 12:17:16 [DEBUG   ] Finished updating board flags in 1.667 seconds
2013-06-29 12:17:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 12:17:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 12:17:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 12:18:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 12:18:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 12:18:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 12:18:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 12:18:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 12:18:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 12:18:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 12:18:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 12:18:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 12:18:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 12:18:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 12:18:16 [DEBUG   ] Finished updating board flags in 1.682 seconds
2013-06-29 12:18:18 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-29 12:18:38 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-29 12:18:39 [DEBUG   ] Got command RPT from MCS: ref #52427
2013-06-29 12:18:39 [DEBUG   ] summary = ERROR
2013-06-29 12:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52427  13 56472 44319601 A  ERRORERROR'
2013-06-29 12:18:39 [DEBUG   ] Got command RPT from MCS: ref #52428
2013-06-29 12:18:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-29 12:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52428  77 56472 44319602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-29 12:18:58 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-29 12:19:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 12:19:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 12:19:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 12:19:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 12:19:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 12:19:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 12:19:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 12:19:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 12:19:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 12:19:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 12:19:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 12:19:16 [DEBUG   ] Finished updating board flags in 1.476 seconds
2013-06-29 12:19:19 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-29 12:19:39 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-29 12:19:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-29 12:20:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 12:20:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 12:20:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 12:20:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 12:20:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 12:20:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 12:20:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 12:20:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 12:20:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 12:20:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 12:20:16 [DEBUG   ] Finished updating board flags in 1.490 seconds
2013-06-29 12:20:19 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-29 12:20:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-29 12:20:59 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-29 12:21:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 12:21:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 12:21:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 12:21:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 12:21:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 12:21:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 12:21:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 12:21:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 12:21:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 12:21:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 12:21:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 12:21:17 [DEBUG   ] Finished updating board flags in 2.317 seconds
2013-06-29 12:21:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 12:21:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-29 12:21:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-29 12:22:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 12:22:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 12:22:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 12:22:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 12:22:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 12:22:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 12:22:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 12:22:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 12:22:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 12:22:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 12:22:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-29 12:22:17 [DEBUG   ] Finished updating board flags in 2.206 seconds
2013-06-29 12:22:19 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-29 12:22:39 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 12:22:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-29 12:23:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 12:23:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 12:23:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 12:23:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 12:23:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 12:23:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 12:23:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 12:23:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 12:23:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 12:23:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 12:23:17 [DEBUG   ] Finished updating board flags in 2.184 seconds
2013-06-29 12:23:19 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-29 12:23:39 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-29 12:23:39 [DEBUG   ] Got command RPT from MCS: ref #52444
2013-06-29 12:23:39 [DEBUG   ] summary = ERROR
2013-06-29 12:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52444  13 56472 44619601 A  ERRORERROR'
2013-06-29 12:23:39 [DEBUG   ] Got command RPT from MCS: ref #52445
2013-06-29 12:23:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-29 12:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    52445  77 56472 44619602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-29 12:23:59 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-29 12:24:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-29 12:24:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-29 12:24:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-29 12:24:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-29 12:24:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-29 12:24:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-29 12:24:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-29 12:24:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-29 12:24:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-29 12:24:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-29 12:24:17 [DEBUG   ] Finished updating board flags in 2.015 seconds
2013-06-29 12:24:20 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2013-06-29 12:24:40 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-29 12:25:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
